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Measuring Newspaper Readership 
by Telephone: Two Comparisons 
with Face-To-Face Interviews' 


Don CAHALAN 
ARB Surveys, Inc. 


Do telephone and face-to-face interviews obtain roughly the same 
answers? The author found they did when a particular newspaper 
readership question was asked of new-car owners in and around 


New York. 


EED FOR A TELEPHONE INTERVIEW technique to 
measure “yesterday” reading of weekday news- 
j papers arose last year, when the New York Herald 
+Tribune planned to survey the reading habits and 
‘characteristics of New York owners of late model 
automobiles. Since these owners were widely dis- 
persed throughout five New York City boroughs and 
23 counties within 50 miles, personal visits to a 
: arge, unclustered sample were considered too costly. 
One established question about “yesterday” read- 
rship (Simmons, 1958) can be asked both in face-to- 
Hace and telephone interviews. The only differential 
fects one might anticipate would result from ges- 


ures or facial expressions of the interviewer or re- _ 


pondent. We doubted that such visual cues played 
% large role, but knew of no actual comparison of 
elephone and face-to-face interviews on “yesterday” 
lewspaper reading. Two such comparisons were 
planned. 


‘The author wishes to thank the New York Herald Trib- 
ne for financial support of these studies, and Dr. Richard 
. Sheldon, its research director, for assistance in all phases 
f the research. 


METHOD 


Both studies used essentially the same method. 
The interviewer asked the standard “yesterday” 
reading measurement questions over the telephone, 
and then arranged to see the respondent the same 
evening. In this follow-up face-to-face interview, 
the interviewer led the respondent through copies 
of all of the preceding weekday’s issues of the seven 
major New York City daily newspapers, ostensibly 
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to find out which items looked “interesting.” After 
the respondent had this opportunity to refresh his 
memory, the interviewer asked whether he was sure 
he did, or did not, look through that newspaper 
“yesterday.” 

If the respondent’s face-to-face answer for any 
paper was the same as his response over the tele- 
phone, he was called consistent. The per cent of 
respondents who were consistent is reported for 
each paper, along with its face-to-face and tele- 
phone readership percentages. 


Study I 

This 169-interview study compared results from 
two subsamples of respondents: 71 interviewed first 
over the telephone and then face-to-face with scan- 
ning of newspapers the same evening, and 98 inter- 
viewed first face-to-face on the same “yesterday” 
reading questions as used on the telephone and 
again immediately thereafter, also face-to-face but 
with scanning of the newspapers. Both groups’ 
second interview thus aided the respondent's recall 
of whether he had looked into or read any of the 
papers. 

Both groups were also asked the same “‘warm-up” 
questions: which of the seven newspapers was re- 
garded as “best for the news” and “for the best 
columnists and features,” and which newspaper was 
looked at most frequently “for the ads.” The names 
of the papers were read to the telephone respond- 
ents in rotated order, and each respondent was asked 
to note down the names of the newspapers in that 
order. In the personal visits, the interviewer pre- 
sented the names of newspapers in a typed list. 

The wording of the “yesterday” reading question, 
identical for the two groups, was: 

“Now we'd like to know what papers you read or looked 
into—either at home or away from home. 

“I will take them one at a time. Have you read or looked 
into a weekday—Not Sunday—issue of (NAME OF PAPER) 
during the past week?” 

(IF “YES” OR “NOT SURE” FOR ANY PAPER) “It is 
very important to us to know when the different papers are 
read. When was the last time you read or looked through a 
weekday copy of (NAME OF PAPER)?” 

(ASK IF “TODAY”) “When was the last time before today 
that you read a weekday copy of (NAME OF PAPER)?” 

This sequence of questions has been used (Sim- 
mons, 1958) to obtain “yesterday” readership as 
volunteered by respondent. 

Telephone respondents were told: 

“The editors and publishers of several of the New York 
newspapers are very much interested in knowing what types 
of newspaper materials are especially interesting. This will 
require me to show you copies of the New York daily papers. 
I’m located close to you; I'd like to come over now and ask 


you these last couple of questions. (I’m not selling newspa- 
pers or anything else, of course.)” 
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The wording of the aided recall, through-the. 


of tl 
newspaper recheck of “yesterday” readership was 
the same for both groups: : 

instr 
“The newspaper people are interested in knowing wham they 
kinds of stories people like to read. Here is a copy of (NAME tio 
OF PAPER, FOLLOWING SAME ORDER AS USED 1\ "0" 
EARLIER PART OF INTERVIEW). As I leaf through this@ per r 
issue, will you please tell me which of the ten numbered D 
pages look interesting to you, and which pages don’t look . 
particularly interesting. views 
“I'd like to know, from your looking through those papers 
now,- whether you are sure you did, or did not, read any of th 
edition of any of them yesterday. If you are not sure, please notes 
look at the papers again. Please remember that some papers 
have early and late editions which may look somewhaify PTob! 
different. supe} 
“How about the (NAME OF PAPER)? Are you sure you I 
did, or did not, read or look through a copy of (NAME Org cent 
PAPER) yesterday? had © 
Standardization of Materials: Since the criterion} "0" 
of reliability was whether the respondent would) 5@” 
recognize a copy of a newspaper as one he had read ‘° ! 
“yesterday,” we tried to aid recognition as unig ©? | 
formly as possible from one interview to another. 
Each interviewer each day was furnished copies of 
the seven New York metropolitan dailies for the '™™ 
preceding day. Editions were those distributed onf§ Set 
the date of issue; no “bulldog” editions (distributed) Wher 
the night before the date of issue) were used. chest 
As in the 1958 Simmons study, each issue wag S™eCt 
stapled so that only ten numbered pages would beg "“™€ 
shown the respondent in asking which pages looked hag 
interesting. This was done to keep the interview — 
Coun 
short. 
To minimize possible respondent confusion be- man : 
tween editions, the ten numbered pages were sei iyo, 
lected from only those pages which appeared in all every 
editions of that newspaper. Where possible, thei 74, 
most distinctive pages were selected: sports, book The} 
reviews, financial pages and the like. For any given iyo j, 
day, all copies for each of the seven newspapeni teryie 
were prepared in uniform kits for each of the in- sey a 
terviewers. Brony 
The limit of ten pages per newspaper probabl\¥ views 
did not hamper the respondent's ability to recogni phone 
it as one he read “‘yesterday.”” He was encouraged tof there 
look at the paper again if he liked, before sayingf}¢venir 
whether he had or had not read it the day before. Hevenir 
Interviewer Selection and Supervision: Eleven 
terviewers completed from ten to 28 interviews each|§ thoug! 
All interviewers had worked on market research{j 
surveys previously, mostly with ARB Surveys. ps 
All interviewers attended two 90-minute pre-surg)' 
vey briefings at the ARB Surveys office, where the ie 
head of the field department, the project directo! P : I 
and the assistant project director discussed detail’ ~ 
JOURNAL OF ADVE) 
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ore-sur tact hovseholds in the telephone sample, and one 


of the pilot study and answered questions. Inter- 
viewers also were provided with five pages of written 
instructions. Regarding the purpose of the study, 
they were told only that it sought to obtain informa- 
tion about car ownership and “to discover newspa- 
per reading habits.” _ 

Daily contact was ‘maintained with each inter- 
viewer by sending him specially prepared copies 
of the seven newspapers, and by telephone calls and 
notes. Interviewers were urged to call in whenever 
problems arose in the field. After the interviewing, 


) supervisors telephoned a randomly selected ten per 


cent of the respondents to find out whether they 
had been interviewed in accordance with instruc- 
tions. 

Sampling and Interviewing Controls: We drew 
two randomly chosen groups of potential respond- 


) ents from the same universe. To get fairly evenly 


matched groups of respondents under conditions 
permitting follow-up visits just after the telephone 
interview, interviewers drew clustered samples from 
street address (“criss-cross”) telephone directories 
where possible (New York City boroughs and West- 


street intersections and told to select every nth 
name on streets extending outward from that point. 
Where criss-cross directories were not readily avail- 
able, as in certain areas of New Jersey and Nassau 
County, interviewers selected names from regular 
telephone books for specific towns or cities in those 
areas. They first selected a page at random, and 
then called every name in a certain position on 
every nth page. 

There was one interviewer cach in Manhattan, 
The Bronx, and Westchester and Nassau Counties; 
two in Brooklyn, and four in New Jersey. One in- 


§ terviewer worked in both Manhattan and New Jer- 


sey and another in both Manhattan and The 
Bronx. Each was instructed to alternate his inter- 
views between the all-visit interview and the tele- 
phone-and-visit interview. If it developed that 
there were more interviews of one type the first 
evening, this was to be balanced off in the second 
evening’s work. 

Interviews were conducted when men _ were 
thought most likely to be home: 5:30-9:30 p.m. 
Tuesday through Friday, and Saturday from 1:30 
p.m. on. Interviewers made up to two calls to con- 


attempt to contact households in the all-visit sam- 
ple. They kept a tally of successful and unsuccessful 


cal!s, 
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We anticipated that the telephone-and-visit inter- 
views would be more difficult than the visit inter- 
views. Greater efforts were exerted (especially in the 
last few days) on the telephone-and-visit interviews 
in order to get an approximately equal number of 
both types. Completed telephone-and-visit inter- 
views totaled 71, and visit interviews 98. All were 
done August 11-15, 1959, covering a full week of 
weekday issues of the seven New York metropolitan 
dailies. Because the telephone-and-visit group took 
more time per completed interview, our goal of an 
equal number of interviews each day for each group 
was achieved only approximately. Roughly equal 
proportions of each type of interview were obtained, 
however, for the first three days and the last two 
days. 

The completion rate for visit-only interviews was 
36 per cent of the eligible households. (See Table 1.) 


‘TABLE 1 
COMPLETION RATES IN STUDY I 


Combined Entirely 
Telephone- Personal 
and-Visit Visit 


Interviewed 227, 36% 
Refused (the combined telephone- 
and-visit group includes instances 
of failure to get a follow-up in- 
terview) 
Qualified respondent not home; or 
nobody home 
Total potentially eligible 
Base 


Ineligible households: 


No auto owned in household 
No male head in household 
Telephone disconnected 


Total households listed as selected 


Principal causes of attrition were: no automobile 
in family, person responsible for automobile not 
home at time of call, and refusals. 

Attrition in the telephone-and-visit sample was 
greater, even with two calls: 22 per cent of eligible 
households yielded completed interviews. Many re- 
spondents would not consent to an immediate visit 
the same evening. Some thought the visit was a ruse 
to sell something, others appeared to feel they had 
answered enough questions already over the tele- 
phone, and some could or would not keep their 
appointments. Obviously, these problems would not 
apply in a survey conducted solely by telephone. 
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RESULTS per cent who refused in the telephone-and-visit 

Respondents reported their “yesterday” reader- sample, this would lower the per cent who were 
ship first by unaided recall, and second by the consistent in the telephone-and-visit group from 95 
through-the-paper aided recognition technique. to 92 per cent, or a drop of three percentage points. 


woul 
aided 
ment 
inter 


Table 2 shows the per cent of respondents who Table 3 compares the first and second readership pecia 
gave the same or different answers both times for percentages for each paper. In no case did they § guest 
each newspaper. The largest proportion of under- differ by more than six percentage points. It should ¥ respo 
or over-staters for any paper was six per cent. be noted in this comparison that one respondent's § his ai 

It is possible that greater attrition in the tele- overstatement can be counterbalanced by another § ship. 
phone-and-visit group may have excluded more per- respondent’s understatement, and vice versa. aided 
sons who tend to be inconsistent in reporting news- One reservation regarding the research design of the 
paper readership. Although we felt response should be examined: the possibility that within sugge 
consistency would be about the same among those either the telephone-and-visit or all-visit group, in-@ focus 
who refused to be interviewed as among others, we dividual respondents may have deliberately tried § nique 
may speculate about alternative hypotheses. to be consistent in their first (unaided recall) and on qu 

Perhaps refusers in the telephone-and-visit sample second (aided recall) responses on the readership § raisin; 
would have been twice as inconsistent as those who items. Ideally, to prevent any conceivable interac § early 


were interviewed. If this were true of the entire 24 tion between individuals’ first and second responses differe 
yor did 
day.” 
Evie 
TABLE 2 an att 
STUDY I: PER CENT OF RESPONDENTS WHO GAVE seen i 
SAME AND DIFFERENT ANSWERS IN SUCCESSIVE INTERVIEWS sthe tv 
Telephone Unaided Recall Face-To-Face Unaided Recall betwee 
Followed by Face-To-Face Followed By Face-To-Face of ind: 
“ Aided Recognition Aided Recognition 
(Base = 71) (Base = 98) system 
Newspaper Same No-Yes Yes-No Same No-Yes Yes-Nommof pers 
A 94%, 0% 6%, 97% 2% 1%, lo 
B 96 1 3 99 1 0 
C 97 0 3 91 6 Bing 
D 93 4 5 92 4 4 for th 
E 94 3 3 98 1 1 § 
F 96 1 3 94 3 3 lormen 
G 98 l 1 95 3 2 their f 
Average 95 2 3 95 3 2 in Tat 
READ: of the 71 interviewed first by telephone with the unaided recall procedure, and then by a face-to-face through-the-news #the co) 
paper recognition measure, 94 per cent gave the same answers on Newspaper A, none first denied readership and later claimed 
readership, and six per cent first claimed and later denied readership. groups 
questic 
cate th 
respon 
TABLE 3 
STUDY I: PER CENT OF RESPONDENTS WHO CLAIMED 
TO HAVE READ EACH NEWSPAPER “YESTERDAY” A se 
Telephone-and-Visit Group All-Visit 1959 t 
(Base = 71) (Base = 98) : 
sample 
Telephone Face-To-Face Face-To-Face 1 Face-To-Face2 ©. 
Newspapers (Unaided recall) (Aided recognition) (Unaided recall) (Aided recognition) the 
A 41%, 42%, 47% 47%, 200 wa 
B 30 28 33 33 i : 
Cc 15 13 17 20 wate 
D 13 7 13 15 tained 
E 11 14 14 14 oe 
F 13 13 12 1 abst 
G 14 13 


vere a 
tor the 
onsiste 


READ: of the 71 respondents in the telephone-and-visit group, 41 per cent claimed to have read Newspaper A “yesterday’f 
when asked on the telephone. Of the same 71 interviewed face-to-face with the newspaper immediately thereafter, 42 per cen 
claimed “yesterday” oe Since the sample was limited to male new-car owners in certain parts of New York, thes 
readership estimates may not be projected to the New York metropolitan area. 
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|-visit would have required two completely independent 
were §§ aided recall and unaided recall samples. Our judg- 
m. 95 ment was that the cost of several hundred additional 
oints. # interviews for this purpose was not warranted, es- 
rship § pecially because the unaided recall and aided recall 
they §§ questions had been carefully planned to minimize 
10uld % respondent awareness of any inconsistency between 
Jent’s | his aided and unaided recall responses on reader- 
other § ship. The questions were quite different: the un- 
aided recall technique required responses in terms 
lesign of the Jast time the newspaper was read, without 
yithin suggesting that “yesterday” readership was the real 
p, in-@ focus of interest. The subsequent aided recall tech- 
tried § nique first led the respondent through the paper 
) and Jon questions of reader “interest” and then, after 
rship raising the face-saving possibility that papers have 
iterac Mearly and late editions which may look somewhat 
ronses fy different, he was asked if he were sure that he did 
jor did not look through each of the papers “yester- 

day.” 

Evidence that few respondents could have made 
an attempt to be consistent in their responses is 
seen in the very close similarity in the results with 
the two methods. If there were some interaction 

ill between first and second responses, the two answers 
e of individuals in the all-visit group might have been 
systematically more consistent than the responses 
Yes-Nomof persons in the telephone-and-visit group, because 
longer time span between the telephone-and- 
: visit interview (one-half to four hours longer than 
4 @for the single face-to-face interview) allowed the 
; former group of respondents more time to forget 
2 (their first (telephone) responses. However, it is seen 

= 


in Table 2 that there is no systematic difference in 
e-news Bthe correspondence of the two responses for the two 
claime! @ sroups of respondents. Thus both the nature of the 
questions and the empirical evidence seem to indi- 
cate that the interaction between first and second 
responses was negligible. 


Study II 


A second pilot study was conducted in October 
1959 to test the telephone method with a larger 
§sample. The methods were essentially the same as 
jin the first pilot survey, except that the sample of 
200 was confined to a comparison of the telephone 

interview with “yesterday” readership responses ob- 
tained from the same individuals the same evening. 
Twelve regular interviewers were assigned the 
mmames and addresses of 500 car registrants, who 


sterday'ga”ere a subsample from the New York area sample 
ee Hor the Herald Tribune study. This group of 500 


onsisted of equal numbers of owners of late models 
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of three low-price cars distributed throughout Ber- 
gen, Essex, Somerset and Union Counties in New 
Jersey; and The Bronx, Brooklyn (Kings), Queens, 
Nassau and Westchester Counties in New York. 

As before, after the respondent completed the 
telephone interview, the interviewer sought the re- 
spondent’s consent to an immediate visit the same 
evening, ostensibly to find out which features and 
articles in yesterday’s newspapers the respondent 
thought to be “interesting.” 

Many of the selected respondents lived so far (up 
to 12 miles) from interviewers’ homes that too many 
follow-up interviews were being lost because of long 
travel time. Accordingly, we stopped drawing re- 
spondents from the regular sample after 47 inter- 
views had been completed. The remaining 153 
interviews were obtained from street address direc- 
tories, as in the first pilot study, in The Bronx, 
Brooklyn, Queens and Westchester County. Poten- 
tial respondents were screened to select owners of 
1957 or later models of automobiles. 

Completion rates: ‘Table 4 presents the account- 
ing of completed interviews in relation to assigned 
potential interviews for the 47 interviews which 


‘TABLE 4 
COMPLETION RATES IN STUDY II 
Total households contacted 1,536 
No answer after two telephone calls 230" 
Total households answering telephone 1,298 
Not eligible for interview (no 1957-1960 auto) 915 
_Eligible for interview 383 
No answer after two telephone calls, 
assumed to own a 1957-1960 auto 70* 
Total estimated to be eligible for interview 453 
Completed both telephone and personal-visit interview 200 
Refusal—telephone interview 72 
Unavailable for telephone interview 
(e.g., out of town during period of survey) 29 
No answer after two telephone calls— 
assumed to be eligible 70* 
Refused personal-visit interview after 
completing telephone interview 42 
Unavailable for personal-visit interview 
after completing telephone interview 40 
Total estimated to be eligible for interview 453 


*NOTE: out of the 238 we may expect that the number 
actually eligible in terms of owning a 1957-1960 car would 
be 383/1,298 or 29.5% of 238 or an estimate of 70. 

were done in conjunction with the main study com- 
bined with results for the 153 interviews in the 
supplementary sample. 

Two hundred, or 44 per cent of those estimated 
to be eligible, were interviewed over the telephone 
and immediately thereafter during the interviewer's 
visit to the respondent’s home. Again, many re- 
spondents balked at an immediate visit, suspecting 
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sales efforts or other impositions, and many were 
unable to be home for the visit that same evening. 

This relatively low completion rate probably did 
not affect the accuracy of the comparison between 
telephone and face-to-face interviews. To do so, it 
would have had to eliminate persons who were 
more likely to minimize or exaggerate their reader- 
ship claims in a telephone interview relative to 
their claims of readership in a face-to-face interview. 
The tendency to claim reading differently on the 
telephone and in personal interviews may or may 
not exist, but it is probably not correlated with 
causes of attrition. 

Table 5 shows the proportions of individuals 
who gave the same answers in both interviews. 


TABLE 5 


STUDY II: PER CENT OF RESPONDENTS WHO 
GAVE SAME AND DIFFERENT ANSWERS 
IN SUCCESSIVE INTERVIEWS 


Telephone Unaided Recall 
Followed by Face-to-Face 
Aided Recognition 
(Base = 200) 


Same No-Yes 


Average 


READ: of 200 interviewed first by telephone with the aided 
recall procedure, and then by a face-to-face through-the- 
newspaper recognition measure, 99.5 per cent gave the same 
answers on Newspaper A, none first denied readership and 
later claimed readership, and 0.5 per cent first claimed and 
later denied readership. 


TABLE 6 


STUDY II: PER CENT OF RESPONDENTS WHO 
CLAIMED TO HAVE READ EACH NEWSPAPER 
“YESTERDAY” 


Telephone-and-Visit Group 
(Base = 200) 


Face-to-Face 
Unaided Recall Aided Recognition 

54.0% 55.0%, 

32.0 38.0 

29.0 29.0 

28.0 29.5 

22.5 22.0 

15.0 15.5 

12.0 13.5 


READ: of the 200 respondents, 54% claimed to have read 
Newspaper A “yesterday” when asked on the telephone. Of 
the same 200 when interviewed face-to-face immediately there- 
after, 55 per cent claimed “yesterday” readership. Since the 
sample was limited to male new-car owners in certain parts 
of New York, these readership estimates may not be pro- 
jected to the New York metropolitan area. To discourage 
guessing, code letters for some of the newspapers have been 
changed from those in ‘Table 2. 


Telephone 


Newspaper 
A 


Consistency for individual newspapers ranged 
from 95.5 per cent to 99.5 per cent, with an average 
of 98 per cent. There was a small, systematic teid- 
ency for telephone readership to be less than the 
follow-up face-to-face through-the-newspaper read. 
ership of the same respondents, but this difference 
was not statistically significant. 

Table 6 compares the first and second readership 
percentages for each paper. 

Clearly, average newspaper readership was virtu- 
ally identical in the telephone interviews and per. 
sonal-visit interviews. 


CONCLUSIONS 


Within the limitations of the sample design used, 
we conclude that: 


1. “Yesterday” readership of daily newspapers 


is measurable over the telephone for con- 
siderably less time and money than personal. 
visit interviews. 


. Telephone measures of “yesterday” reader- 
ship can be expected to be the same as 
through-the-paper readership measures ob- 
tained in visits in at least 95 per cent of in- 
dividuals’ responses on specific newspapers. 


. Telephone and face-to-face “yesterday” news. 
paper readership percentages can be ex. 
pected to differ by no more than a few per- 
centage points. 


. These findings apply only to the rather 
highly routinized and thus rather memora- 
ble readership of newspapers. They may ot 
may not apply equally to the measurement 
of audiences of other media. 
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A Factor Analysis of the Liquor 
Preferences of French Consumers 


JEAN STOETZEL 
Institut Frangais d’Opinion Publique 


If complex behavior is caused by a few simple motives, they can be 
found in the patterns of that behavior. Professor Stoetzel illustrates 
this premise with a factor analysis which tentatively explains con- 
sumer preference for nine liquors in terms of their sweetness, price 
and regional popularity. 


PpRACTICAL REASONS ACCOUNT for the introduction 
of motivation research in the field of market 
study. When it becomes desirable to influence con- 
sumer behavior and attitudes, a simple assessment 
is no longer adequate and there is an obvious need 
or a deeper knowledge of their roots. The word 
‘motivation” expresses this concept of psychological 
ausality. 
But the very concept of causality is by no means 
simple one, as many Western thinkers have re- 


gpeatedly observed. Aristotle felt that it was neces- 


ary to distinguish among four kinds of causes. 
In modern times, Malebranche and Hume have 
lemonstrated that in the realm of psychology as 
ell as in physics, we are utterly unable to compre- 
end the effectiveness of a given cause, and that— 
owever vivid—our spontaneous intuitions of cau- 
sality are hollow and meaningless. 

It would be a mistake to dismiss these remarks 
by scornfully characterizing them as philosophical. 
It is most important to be fully aware of what we 
are searching for. In the perspective of behavioral 
psychology, when we face the matrix of simultane- 
us preferences expressed by a group of consumers 
br voters, what corresponds to the popular concept 
of causality is simply the unique configuration or 
pattern made up by the diverse phases of the stimu- 
us situation, the characteristics of the subjects and 


wheir behavior. And it is quite significant, I believe, 


hat in French or German, the word motif or motiv 


@S used to convey that very idea of a pattern in the 


eld of architecture or music. It appears that in 
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psychology, too, the notion of motivation can be 
resolved conceptually into that of a pattern. Need- 
less to say, however, such structures are never given 
in actual experience, but are only intellectual con- 
structions. 

This inevitably leads us to the concept of the 
model. A model is a system of relationships, mathe- 
matically expressed, apt to reach a high degree of 
complexity, and such that when experience has set 
the values of the parameters, the values of all the 
variates can be deduced in agreement with the 
nearly inexhaustible data of observation. 


METHOD 


Such models of preference for several items by a 
population are made available through factor anal- 
ysis. At first it appears that the individual choices 
between the several items are correlated, so that 
given a choice by an individual, all his other choices 


JEAN STOETZEL is professor 
of social psychology at the Uni- 
versity of Paris (Sorbonne) and 
director of the Institut Frangais 
d@’Opinion Publique (IFOP), 
which he founded in 1938. His 
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the post-war opinions of Japa- 
nese youth, Without the Chrys- 
anthemum and Sword (Columbia 
University Press, 1953). In addi- 
tion to directing the Sociological 
Research Center in Paris, he edits Sondages, a French public 
opinion quarterly, and the French Sociological Review. M. 
Stoetzel has served as president of the World Association of 
Public Opinion Research (WAPOR), the French Psycho- 
logical Association and the International Association of 
French-speaking Psychologists. 
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can be forecast within determined probability lim- 
its. Later the whole matrix of correlation coefficients 
can be rationally computed from an appropriate set 
of variates characteristic of the items preferred. 

The intended goal has thus been reached; a com- 
plex system of relationships has been established 
through which individual preference judgments, 
not one at a time but simultaneously, can be de- 
ductively reproduced. The principles of this repro- 
duction are the factors—abstract mathematical 
parameiers computed without any personal inter- 
ference by the analyst. The analysis may thus be 
called entirely objective in the sense that anyone 
making use of the same procedure will find the 
same results. This feature gives way, as will be made 
clear later, to the possibility of turning over the 
burden of computation to machines. 

Human judgment, however, is needed at the next 
stage when assumptions are formulated concerning 
the significance of the factors. Still, those assump- 
tions themselves can be operationally expressed 
and consequently can be experimentally tested. The 
conclusions of the study are quantitatively phrased. 
Not only are the preferred items ranked by their 
loadings in the factors, but also the contribution of 
each factor to the variance of the empirical data is 
quantitatively assessed. 

The preceding statements obviously need con- 
crete illustrations. For this purpose, we will make 
use of a body of data gathered in the course of a 
market survey made in February 1956 by the French 
Institute for Market Research (ETMAR). 

Personal interviews were conducted February 
9-21, 1956 with 2,014 adult men and women who 
constituted a representative cross-section of the 
French population selected by quota sampling 
methods. All information was obtained in the 
home, in 161 different localities, by interviewers 
habitually employed by ETMAR. A toial of 1,442 
completed interviews were obtained, for a comple- 
tion rate of 70 per cent. 


In the course of this survey, the following ques. 
tion was asked: 


Which of the following liquors do you per- 
sonally like best? You are requested to clas- 
sify them by ranking on top the one you 
like best, ending up with the one you like 
least. 


(A card with the following items was shown the 
subjects.) 
ARMAGNAC 


CALVADOS 
COGNAC 


RESULTS 

Product-moment correlation coefficients were com: 
puted between the nine simultaneous choices re 
quested from each respondent (see Table 1). ‘The 


KIRSCH 
MARC 
MIRABELLE 


RUM 
WHISKEY 
LIQUEURS 


ranks given to Armagnac and Cognac on the one{ 


band, and to Kirsch and Mirabelle on the other, 
showed positive, rather high correlations (.37 and 
.25). Armagnac, Calvados, Cognac and Marc were 
negatively and rather strongly correlated (—.38 and 
—.39) with Liqueurs. Rankings of Kirsch, Mirabelle, 
Rum and Liqueurs were negatively correlated with 
the other rankings. Most correlation coefficients with 
Whiskey ranks were small, the most noticeable ex: 
ception being the Whiskey-Liqueurs correlation, 
which was rather highly negative, —.24. To sum up, 
the whole matrix of the 36 correlation coefficient 
revealed a rather clear-cut pattern of preferences bi 
French consumers. 

We can now turn to the factor analysis of thi 
matrix. The procedure used was Thurstone’s cet: 
troid method. Three factors have been extracted. 

The analysis was discontinued after the extrac 
tion of the third factor because the third residual 
matrix was such that two-thirds (22/36) of the fig 


of the corresponding correlation coefficients. The 
values for the correlations deduced from the thre 
factors differed 21 times out of 36 from the actuall 
observed correlation coefficients by a quantity le 
than or equal to three standard errors. 


TABLE 1 
CORRELATIONS BETWEEN RANKINGS OF THE NINE LIQUORS 


Armagnac Calvados Cognac 


Mirabelle 
Rum 
Whiskey 
Liqueurs 
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Kirsch Marc Mirabelle 
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A NOTE ON FACTOR ANALYSIS 


Factor analysis is a way of explaining the correlation between various measures by as- 
suming a few underlying factors which influence them all. 
For example, we may have a set of tests of abilities all based on very different tasks. Yet 
we might find that people who do well on one test generally do well on many of the others. 
This might lead us to suggest that, to some extent at least, the tests measure the same thing— 
the same factors. }actor analysis is the mathematical technique for finding out how many 
factors are needed to explain the agreement between tests, and how much each test measures 
each factor. 
EY The first step is to determine the degree to which the tests agree with one another. For 
ied this we calculate the correlation coefficients between each pair of tests. These can be ar- 
ranged in the form of a “correlation matrix” as Professor Stoetzel has done for preferences 
re com: in Table 1 on the page opposite. 
ices re. From this, by appropriate procedures, is derived a ‘factor matrix’ which shows how 
). The each test is correlated with each underlying factor. Professor Stoetzel’s factor matrix is given 
he once as Table 2 below. 
other It is easy to see how the correlation matrix of preferences is related to the factor ma- 
37 and trix. The correlation between the preferences for two liquors is explained by the way each 
‘Cc Wert of them is correlated with underlying factors. 
38 and Take Cognac and Armagnac for instance. The correlation between them is made up 
rabelle, like this: 
<d. with Correlation between Cognac and Armagnac = (loading of Cognac on Factor I) (loading 
ts with of Armagnac on Factor I) + (loading of Cognac on Factor II) (loading of Armagnac on Fac- 
ble ex; tor II) + (loading of Cognac on Factor III) (loading of Armagnac on Factor IIT) = (—.60) 
elation, (—.52) + (—.17) (—.03) +. (.42) (.14) = .3012 + .0051 + .0588 = .3651. 
um up This compares with the reported correlation of .37. 


fficienty Some of the other correlations are explained less well in terms of factor loadings. This 
nces bi may be due to further factors not extracted. 


of 
e’s Cell 
tracted. 


Table 2 gives the factor loadings for the different order and reveals, in the abstract but strict sense of 

iquors. the word, factors, that is to say, the causes of these 
TABLE 2 similarities and differences. Passing from the ab- 

wees LOADINGS IN THE THREE FACTORS stract to the concrete, from the mathematical to the 

residual ; Factor I Factor li Factor II psychological, is indeed delicate. We shall now pro- 
ro % re : ceed with this kind of interpretation by way of illus- 


0.46 tration. 
ts. The 0.17 


actually —0.49 The largest loadings in the first factor are, in 
tity leo — order, those of Liqueurs, Kirsch, Mirabelle and the 
) ‘This figure is certainly too high and should not exceed smallest those of Calvados, Cognac and Armagnac. 
he maximum of 64, A reiteration of the factor analysis, We are inclined to surmise that the first factor 
discriminates between sweet and strong liquors. We 
nalities, would very likely lessen it. a ey 

conclude that this distinction between sweet and 
This table, and still more clearly a tri-dimen- strong liquors is the first principle upon which con- 
Whiskeional geometrical representation, show again what sumer preferences are based. Let us emphasize this 
Was clear from the correlational matrix; the sim- point: this principle is the first, not only in the 
ilarity in the rankings of Armagnac and Cognac, sense that it has been analyzed first, but also in the 
irsch and Mirabelle and also the main differences sense that it is the most important. It is in effect 
ilready observed. In addition, factor analysis puts this first factor which (except for Rum and Marc) 

hose similarities and those differences in a complex contributes most to the variance in preferences. 
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A GRAPH OF THE FACTOR MATRIX Armag 


brefere 
This is a photograph of a plastic model which graphs the factor matrix. Since there are Me alee 


three factors accounting for liquor preferences, the graph is three dimensional. The first 
axis runs across the page and represents, left to right, the dimension strong to sweet. Cal- wie 
vados, for example, is strong; Liqueurs are sweet. The second dimension is inexpensiveness a asi 
and this runs up and down the page. Rum, for example, is inexpensive and exhibits plenty vith th 
of this factor. The third dimension is less easily seen because it runs into the page. It repre- 
sents local or national preference. The direction toward the reader shows local preference; 
national preference is indicated by positions away from the reader. ONC] 
One interesting feature of this diagram is that it indicates the correlation between vari- This 
ous preferences. Kirsch for instance enjoys about the same factor loadings as Mirabelle and ble cor 
the two liquors are, as we see from their neighboring positions in the model, positively cor- otiva 
related in preference. bf cons 
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TABLE 3 
' MEAN PREFERENCE RANKS BY REGION 


Calvados 


4.30 
3.68 
4.62 
4.75 
5.87 
5.56 


Armagnac 
4.90 
4.77 
4.42 
4.23 
5.21 
4.57 


Cognac 
3.75 
3.80 
4.16 
4.26 
3.92 
3.15 


ormandy, Brittany 
he Loire 


3.32 


3.99 
3.64 


3.62 


4.36 
3.92 


4.43 
.2393 


5.49 
4.89 


5.04 


Grand Mean 
2446 


Variance 


The second factor ranks the preference judg- 

ents in an entirely different dimension. This is 
uite natural since it is an essential property of the 
actors to be mathematically independent. The 
argest loadings characterize the preference judg- 
1ent on Rum and Marc; the smallest on Armagnac 
pnd Mirabelle. A likely interpretation of this factor, 
hich is given here only as a possibility, is that it is 
elated to the price, low or high, of the different 
tems. These differences in the prices of the several 
tems, it may be observed in passing, need not be 
established objectively on the retail market. It is 
sufficient that they be so perceived psychologically 
by the respondents. This interpretation could be 
ested in a separate survey. 

The third factor reaches its maximum in the case 
pf Rum and Cognac, its minimum with Mirabelle 
pnd Marc. We have reasons to interpret it as re- 
ated to the sociological variability of preference 
udgments within the public. A study of the mean 
ating given to each of the items throughout the 
lifferent geographic regions of France (see Table 3) 
hows that the loadings in Factor III are negatively 
orrelated with the variance of the mean ratings in 
he case of Marc, Mirabelle, Calvados, Kirsch and 
Armagnac, all of which enjoy a definite traditional 
preference in some region or another. In the case 
bf the other liquors, for which regional differences 
re felt to a much lesser degree, it is likely that a 
rore detailed study would show some other varia- 

le such as sex or socio-economic level to correlate 
vith their loadings in Factor III. 


ONCLUSION 
This example may substantiate faith in the possi- 
ble contribution of factor analysis to the problem of 
otivation. In the case studied, our interpretation 
bf consumer behavior would be the following. 
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Kirsch 


Marc Mirabelle 


5.78 
6.62 
6.75 
4.57 
5.92 
6.04 


Rum Whiskey 


7.65 


Liqueurs 


6.36 


5.45 
6.25 


5.98 


The major principle of liquor preference in 
France is the distinction between sweet and strong 
liquors. The second motivating element is price, 
which can be understood by remembering that 
liquor is both an expensive commodity and an item 
of conspicuous consumption. Except in the case of 
the two most popular and least expensive items 
(Rum and Marc), this second factor plays a much 
smaller role in producing preference judgments. 
The third factor is concerned with the sociological, 
and primarily the regional, variability of the judg- 
ments. 

Consequently the recommendation of a system- 
atic use of factor analysis in market studies seems 
justified. This procedure, as may have been noticed, 
leads to no change in the usual techniques of sam- 
pling and interviewing. The main reason why 
factor analysis has been used only on rare occa- 
sions in market research is probably that it re- 
quires rather laborious calculations. This difficulty 
is entirely overcome today thanks to electronic 
calculating machines. The preceding analysis was 
entrusted to I’Institut Européen de Calcul Scien- 
tifique of IBM-France. Once a program has been 
established, an IBM 704 electronic machine is fed 
with the ordinary punch cards of the market study 
at the rate of 150 per minute, during which time all 
significant data are read and enregistered and all 
arithmetic computations performed. Results are 
then printed at the speed of 100 lines a minute. Pre- 
liminary and final manipulations included, the 
working time was less than three-quarters of an 
hour. 

We believe that factor analyses carried out under 
such conditions open up far-reaching and novel 
possibilities to market and opinion research. 
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The Qualitative Values 
of Advertising Media 


W. M. WEILBACHER 
Dancer-Fitzgerald-Sample, Inc. 


HE ADVERTISING AND MARKETING practitioner is 
[poner concerned with the evaluation of 
advertising media in terms of their qualitative or 
intangible values. This growing interest stems from 
two basic forces. 

First, individual media and medium vehicles 
have had important successes in measuring quanti- 
tatively the characteristics possessed by both them- 
selves and their direct competitors. Quantitative 
audience measurements are now well established 
for the major media, even though there are varia- 
tions from medium to medium in the measurement 
bases used and in the number of measured vehicles. 
In addition, advertising message exposure data are 
increasingly subject to quantification, publicly for 
the printed media and, at least to some extent, in 
unpublished, private studies for the broadcast me- 
dia. These message exposure studies are now se- 
verely limited in their coverage of individual me- 
dium vehicles, but future research studies will un- 
doubtedly increase the knowledge base in this area. 
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A medium’s qualitative value has been used to mean its audience 
composition, its editorial personality, or its contribution to advertis- 
ing effectiveness. The author evaluates these definitions in terms of 
available research techniques, meaningful comparisons within and 
between media, and media selection. 


Secondly, there is an increasing awareness of the 
need for media studies measuring the additiona 
non-quantitative values accruing to an advertising 
message only because it is placed within a particula 
medium or medium vehicle. Such studies woul 
measure the media values existing independent 
of the number of people to whom the message ha 
been exposed. 

These two forces are clearly implied by Alfreif 
Politz in his introduction to the recent Reader 
Digest-Saturday Evening Post exposure study: 


“Exposure is entirely the responsibility of the mediut 
though the medium’s function goes beyond that—into t 
mood it creates in its readers, viewers, or listeners, their con 
fidence in the medium and other benefits the medium ¢ 
livers for its advertising content. These other benefits are n0 
measured in this study, which confines itself to exposure 
(Politz, 1960, p. 8). 


Increasing awareness of the precise size of medi 
exposure potentials is leading to the desire {0 
knowledge of what happens to an exposed pers0i 
as a result of the placement of a particular advert 
ing message in one medium rather than another, 0 
in one medium vehicle rather than another. Sud 
media effects are commonly referred to as qualiti 
tive or intangible media values. This paper di 
cusses and analyzes three basic issues concerni 
the qualitative values of advertising media: 

What is the qualitative value of an advertising 
medium or advertising medium vehicle, and hoy 
do currently available studies define and illustrat 
this value? 

What is the significance of current research 0 
qualitative media values from the standpoint 0 
research methodology, inter- and intra-media co 
parisons, and effective media decisions? 

What are the implications for future develo 
ments in media research? 
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QUALITATIVE VALUE DEFINED 


There seems to be little published agreement. 


among either advertising theorists or practitioners 
as to what, indeed, qualitative media value is. No 
single definition of qualitative value is common to 
most recent studies which either imply or state di- 
rectly their purpose to be a measurement of quali- 
tative value (Social Research, 1954; Social Research, 
1959; Motivation Analysis, 1957; Coffin, 1959). This 
is in sharp contrast to the rather generally accepted 
definitions for audience membership underlying the 
basic quantitative media studies. 

In informal or colloquial advertising industry 
usage, qualitative media value seems to connote 
some plus value of three specific kinds. 

First, qualitative media value is frequently used 
to mean the qualitative characteristics of media 
audience members. These qualitative characteris- 
tics are merely descriptions of the audience at- 
tracted to the medium or vehicle by its editorial 
content. The value of these qualitative character- 
istics arises when they are demonstrated to be differ- 
ent from those possessed by the audiences of compet- 
ing media or vehicles, or the general population. 

There is no direct and logical connection be- 
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Alfreif 
eadere ONCED A description of the characteristics of an au- 

dience and the interaction of an exposed audience 
r member with the medium or vehicle to which he 
mediu} is exposed. Nor do the characteristics of the medi- 

reir cof, UM's or vehicle’s audience members directly and 


lium (ef logically enhance advertisement effectiveness. The 
xposury fact that an audience member is typically better 


educated or has more children, a higher income, or 
mediqy more hard cover books per year, etc., has not 
ire {fy been shown to improve his receptivity to or ap- 

perso praisal of a medium or its advertising messages. 

dyertitg ‘It is, however, still possible to build a logical (if 
ther, o& bypothetical and indirect) case for the existence of 
r, Connection between audience member character- 
qualit istics and the interaction between these exposed au- 
per dil dience members and the medium or vehicle. Such 
cerning 4n indirect case assumes that: 


ie If an audience of certain characteristics is developed by a 
ertising@ medium or vehicle because of its editorial specialization, 
nd howe" whatever, then this specialized audience has a higher 

level of interest in specific subjects. It then follows that 
lustral editorial content provides a more compatible environment 
for certain kinds of advertising messages and compels more 
attention to this environment from the audience members 
demonstrated to have unique characteristics. This interac- 
tion between the exposed audience member and the medium 
or vehicle should lead to greater receptivity to such adver- 
Using messages and to greater advertising effect. Such an 
yy @tgument can be carried to any kind of qualitative audience 
characteristic, but seems most powerful when based on 


develop, a qualities generated by a specific editorial specializa- 
n, 
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There is no proof that qualitative media values 
exist for the advertiser because of particular audi- 
ence qualities. Certainly there seems every good 
reason to believe that audience quality must be of 
importance to a limited number of advertised 
brands (or advertised institutions) which, them- 
selves, have specific and limited characteristics. The 
qualitative media value possibly caused by that 
audience quality would, however, vary from brand 
to brand (and institution). 

A second meaning frequently given to qualitative 
media value involves the overt characteristics of the 
medium or vehicle itself and the way they are per- 
ceived by its audience. These qualitative values 
have to do with the role played by the medium or 
vehicle in the lives of the audience; with the audi- 
ence member needs fulfilled by the medium or 
vehicle; and with the positive or negative attitudes 
toward it and its advertising created by the medium 
or vehicle in its audience. 

In this sense, a qualitative media value is the 
value attributed by an audience member in terms 
of the real benefit or attitudinal benefit he derives 
from his contact with the medium or vehicle. Be- 
cause media or vehicles tend to be very complex, 
they lend themselves to rather broad and involved 
description at this level. For example, in one news- 
paper study (Social Research, 1954, pp. 15-16) it 
was concluded, in part: 

“The newspaper is an integral part of the every-day life 
of a community. A citizenry identifies with the community via 
its newspaper. . . . Further, there is faith in the newspaper; 
this faith is a confidence in the integrity and believability of 
the content, and that what appears in its pages can pretty 
well be acceped as true... . It was seen that the people 
[audience members] who use newspaper advertising regard it 
as a satisfying kind of advertising . . . a kind of advertising 
for them, and appropriate to their way of life... .Im- 
mediate, and close to the process of decision and purchase. 
... Sensible, easily understood and down-to-earth... .” 

Similarly, a radio study (Motivation Analysis, 
1957, p. 25) concluded: 

“Listeners pay more attention to these CBS Radio stations 
than to the leading independents. Listeners distinguish be- 
tween stations—regard these CBS Radio stations more favor- 
ably than the leading independents. Listeners believe these 
CBS Radio stations more than the leading independents— 
both their programs and their advertising. It seems it’s a 
matter of authority.” 

These studies seek to establish and describe the 
kinds of interaction existing between the medium 
or vehicle and its audience. 

This kind of qualitative media effect is defined 
in terms of words like “authority,” “believability,” 
“essential,” “timeliness,” “iinmediacy,” “prestige,” 
“mood,” “provocative,” etc. These translate into ad- 
vertising effect if one can assume that the favorable 


13 


«666 


3 
pis 
f 
: 


reception of the medium or vehicle generalizes to 
the advertising it carries. 

That differentiated media personalities exist is, 
of course, one thing; that such personality factors 
relate to the advertising messages carried in the 
individual vehicle is quite another. The logic is 
clear and compelling, but there is no clear proof 
that it is correct. It remains to establish the precise 
relation of these media personality factors to adver- 
tising effect for individual brands and institutions. 

Furthermore, the extent of advertising enhance- 
ment contributed by this kind of qualitative me- 
dium value must be different between advertising 
messages. The same editorial “authority,” for ex- 
ample, must have an entircly different effect on cos- 
metic advertising as on that for earth moving equip- 
ment. 

The third general usage of the phrase qualita- 
tive media value refers to the total positive or neg- 
ative effect on audience member response to an 
advertisement because it has appeared in a particu- 
lar vehicle. In this usage, qualitative media value 
is the total increment to advertising message effect 
contributed by the medium or medium vehicle. 
This qualitative medium value includes such indi- 
vidual contributors to overall qualitative value as 
the special characteristics of the audience attracted 
to the medium or vehicle and whatever personality 
characteristics are attributed to it by its audience 
members. Implicit in this third usage of the term 
qualitative media value is the notion that, beyond 
individual and definable sources of qualitative 
value such as demographic and attitudinal char- 
acteristics, the medium may also contribute com- 
pletely undefined, even unanticipated, values to the 
advertising process. This point of view holds that 
it is wasteful to attempt to separate out and meas- 
ure a complex pattern of myriad causes of medium 
or vehicle enhancement of advertising effect. Simi- 
larly, this point of view rejects the general measure 
of individual media characteristics preferring, 
rather, the specific measure of media effect on in- 
dividual advertisements. 

Thus, the objectives of a study conducted for 
Fortune are stated: 


“1. To determine whether the impact of an advertisement is 
modified by the business magazine in which it appears, and 
if so, in what ways it is modified; 

“2. To determine the degree of advertising impact achieved 
by three business magazines, Fortune, Business Week, and 
U. S. News & World Report” (Social Research, 1959, p. ii). 
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The logic in support of this point of view runs 
as follows: 

The concept of qualitative media value assumes that ex. 
posure to advertising occurs after exposure to a medium or 
vehicle has occurred. Once a medium or vehicle has achieved 
audience member exposure, any further value it contributes 
must be made in the context of the actual advertising mes. 
sage. This specific contribution almost certainly varies among 
different advertising messages (for example, as between cos. 
metics and earth movers). Therefore, in order to asses 
qualitative media value, its influence on the effect of a 
specific advertisement must be determined. 

This usage of the term qualitative media value 
focuses on the relation of the advertisement to the 
audience member rather than on the relation of 
the medium or vehicle to the audience member. No 
indirect logic is required in this usage—it says, im 
plicitly, “Qualitative media value exists; measure 
its effect on advertisements and make comparisons 
in terms of this measurement.” The two previous 
usages of qualitative media value, on the other 
hand, require an intervening argument to link the 
measured quality of the medium with its advertis. 
ing effect and fail to recognize the probability that 
qualitative media values will vary from advertise. 
ment to advertisement. 


WHICH DEFINITION IS BEST? 


These three usages of qualitative media value 
have served as bases for research published by ad: 
vertising media. Interesting and valuable studies 
have been produced on the basis of each. At the 


same time they permit completely different conclu-} 


sions concerning the qualitative potential of the 
same medium or vehicles. 

This is, of course, to be expected. Each medium 
has its own strengths and weaknesses and it would 
be foolish for a medium not to explore and illus 


trate its own strengths. Similarly, it is in the bestf 


interest of the advertiser to understand the peculiat 
characteristics and strengths of each medium since 
his advertising goals are highly complex and varia 
ble, and since he must know which media are best 
adapted to each of his goals. 

In this situation the advertiser must recogni 
that much qualitative media research is not pe 
tinent to his own objectives or goals simply becaust{ 
it is research and describes particular peculiarities 
of particular media or vehicles. Rather, he must seek 
out those studies which bear directly on his ow 
advertising efforts and it is, of course, in the best 
interest of the advertiser to insist that such research 
become increasingly less general. 
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r runs In this context, it is pertinent to analyze each of pends, on the other hand, upon how well expo- 
the three points of view concerning qualitative me- sures can be defined in equivalent terms for the 


i dia values presented above in terms of three criteria. various media. A detailed discussion of this subject 
at ex- 


ium or First, what potential and what limitations do is beyond the scope of this paper. Much work has 
chieved ff each of these points of view have from the stand- been done with this controversial and difficult sub- 
tributes 


ig mes ff Point of research methodology? Do these concepts ject, and the most authoritative statement is un- 
among § of qualitative media value lend or not lend them- doubtedly that forthcoming from the Audience 
on can Selves to strong research methodology? Concepts Committee of the Advertising Research 
t of a Second, are the concepts of qualitative media Foundation. 

value adapted to both intra- and inter-media com- Pioneering studies (e.g., MRCA, 1960; Politz, 


value}. parison? 1953) which have attempted to compare media on 


to the Third, what potential value does each of these a common exposure basis have generally been sub- 
ion off studies have in the media selection process? ject to criticism on one or more of the three follow- 
er. No ing grounds: 

ys, im. Audience Member Characteristics First, the same criterion for exposure is not used 


easure 1. Research Limitations: From the research stand- for each of the various media measured. 

irisons§ point, the description of audience member char- Second, the criterion for exposure is at such a 

eviow acteristics is, given an acceptable definition of au- general level that none but the broadest generaliza- 
other, ‘ience exposure, straightforward enough. Using tions about an entire medium can be drawn. AI- 

nk the) 2ny of the current exposure definitions, it is simple though helpful, these generalizations frequently are 

enough to count those exposed and develop volu- not apt in specific media choice situations. 

minous breakdowns of the various characteristics of Third, the exposure measurement ignores all of 


lvertis. 
ty that ‘ 
vertise- audience members. the many other bases upon which choices between 
2. Intra- and Inter-Media Comparison: (a) When media are actually made (Brown, Lessler and Weil- 

these measurement criteria are used as a basis for bacher, 1957, chaps. 13-15). Exposure is but one 
intra-medium comparison, vehicles within the same of the many characteristics and values offered by 

medium can be evaluated in velliagnigar straightfor- the various media; exposure data rarely (if ever) 

value’ ward manner. Many of the readily available media can be used alone to choose between media. To say 
by ad} studies provide media data which are completely that many of these other characteristics and values 


studies comparable in this sense. 4 : cannot or have not been quantified does not dimin- 
At the It is, of course, the responsibility of the advertiser ish their significance nor their importance in ac- 


conclu-} to examine such studies to assure himself that the tual mundia choice situations 


of the} exposure criterion used for measurement is ger- 3. Value in Media Selection: Such characteristic 


mane to his own advertising goals. He should also comparisons do not develop a direct connection 
edium# scrutinize the study design to understand which between qualitative media value and incremental 


—— characteristics, if any, of the media vehicles meas- advertising effect. There is no clear quantitative 
‘ ye ured are highlighted or ignored, and to understand measure of what or how much the medium or vehi- 
€ best] which of the measured media this tends to favor cle contributes to the advertising process independ- 


eculiarl or short-change. ent of exposure. These measurements should prove 
sane For example, the Nielsen, Average Audience helpful but not final guidance to individual adver- 


pe exist is now generally preferred to the tisers in choosing between vehicles within media 

re ielsen Total Audience Measurement in evaluat and give them limited insight into the nature of 


ing broadcast vehicle audience exposure to the av- the differences existing between media 
cogniz} erage commercial contained within vehicles. The 
ot per) Total Audience Measurement tends to be rejected 


pecausf because, based as it is on a six-minute exposure, it Media Personality Studies 
iaritics| produces progressively larger audience estimates as 1. Research Limitations: The research difficul- 
ust seek} the length of the program increases regardless of ties are relatively more intense when it comes to 
is own the number of people exposed to the average min- the measurement of consumer attitudes and _ re- 
he best ute. sponses to media and media vehicles. 
esearch (b) The usefulness of inter-media comparisons A review of typical studies of this type and inde- 


made on the basis of audience characteristics de- pendent pilot research in this area of consumer 
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attitudes and responses to media suggest the follow- 
ing, admittedly negative, methodological hypoth- 
eses: 

First, consumers see little causal connection between media 
and the advertising messages which they carry. They think 
of a medium not as a carrier of advertising messages but 
as carriers of service, news and entertainment. Thus the view- 
point, reaction and total orientation of the consumer toward 
the medium is generally unrelated to advertising, to the 
interaction of advertising messages with the medium, or to 
the perspective of professional advertising people. 


Assuming this hypothesis to be correct, at most, 
consumers can react to the editorial content of ad- 
vertising media; most, if not all, attempts to de- 
velop consumer testimony as to the relation of me- 
dia and copy, either generally or specifically, must 
be fruitless. 

Second, consumers have almost no idea of their own rela- 


tive involvement with a particular advertising medium or 
medium vehicles. 


Assuming this hypothesis to be correct, varia- 
tion in consumer involvement with media or the 
advertising messages they carry is not determinable 
from direct consumer testimony. 

2. Intra- and Inter-Media Comparisons: Studies 
of this type tend to give the feel, the flavor, of a 
medium or vehicle. ‘They do not, in their current 
form, give precise or quantified descriptions which 
permit objective comparisons. 

Because these studies contribute most on the 
level of subjective appraisal through the delinea- 
tion of individual medium or vehicle personalities, 
they are most helpful in comparing those media or 
vehicles which are least similar. Thus, this ap- 
proach is likely most fruitful at the inter-media 
level, rather than in application to intra-media 
comparisons, since individual vehicles tend to be 
more, rather than. less, alike. 

3. Value in Media Selection: These studies of 
qualitative media values and their contribution to 
advertising effect are limited by their fuzziness, 
their lack of quantification and their essential de- 
pendence upon consumer introspection as a data 
source. Some steps are now being taken to overcome 
these failings through the use of techniques drawii 
particularly from projective psychology (Institute 
for Motivational Research Inc., 1960). - 

While these studies unfailingly give the flavor 
of the way media affect consumers, they generally 
do not, however, connect this flavor to the effect of 
specific advertising. This is left to the advertiser to 
appraise within the context of his own perspective, 
perceptiveness and problems. 
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Controlled Advertisement Effect Studies 

1. Research Limitations: From a research stand- 
point this approach seems to have no essential limi- 
tation and great potential, particularly as classic 
experimental designs are adapted. The research 
possibilities seem to be limited only by the imag: 
inations of the media researchers themselves. How \ 
much of a limitation this will be remains to be | 
seen. 

But which criterion of advertising effect is to be 
used? It seems likely that many of the traditional 
and experimental copy research approaches can be 
transferred to this work, since, after all, it largely § 
involves the measurement of differential copy effect 
under varieties of controlled media conditions, copy 
held constant. What copy research measures might 
be adaptable is a subject beyond the scape of this 
paper, but certainly worth exploring. 

2. Intra- and Inter-Media Comparisons: (a) All 
of the optimism in the preceding paragraphs ap- 
plies directly to intra-media comparisons. 

(b) It is doubtful, however, that this kind of com- 
parison can be made between media, at least given 
the current state of the copy research art. 

It seems unlikely that copy designed for and ap- 
pearing in different media will be judged “equal” 
enough to permit controlled media testing. Unless 
prior agreement can be reached, for example, that 
television advertisement “A” is equivalent in com: } 
munication content with printed advertisement 
“B,” except for differences in effect contributed 
solely by the medium, it seems fruitless to attempt 
to measure the differences in effect contributed 
solely by the medium. It seems unlikely that prac 
titioners or independent arbiters can reach agree- 
ment as to what constitutes “constant” copy as be- 
tween media. Certainly, if a device is available for 
facilitating such agreement, it will be welcomed. 

3. Value in Media Selection: Of the three ap- 
proaches reviewed, the third type seems to offer the 
most promise of advancing our knowledge of how ff 
to make media decisions between vehicles of a 
given medium. It is most promising because it of 
fers the opportunity of measuring qualitative me- 
dia values at the level of the advertisement. 

Inter-media comparisons of qualitative media 
value must, for the time being, apparently be made 
at the level of media effect on audience members. 
This kind of measurement can take the form ol 
describing audience characteristics or of describing 
audience attitudes toward the medium, as dis 
cussed above. 
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IMPLICATIONS FOR MEDIA RESEARCH 

This analysis suggests two basic conclusions for 
media research. 

First, media research, as traditionally defined and 
practiced, may be ill-equipped to handle success- 
fully measurement in the area of qualitative media 
effect. The orientation of large-scale consumer sur- 
veys aimed at identifying various audience char- 
acteristics—from audience membership to frequency 
of exposure to the average page—is important to 
the future development of media research. Equally 
important, however, is an orientation toward the 
effects of individual advertisements as measured by 
the qualitative techniques of modern-day behav- 
ioral science. Progress will depend upon an appre- 
ciation of experimental design and its potential 
contribution when combined with measurements 
of advertisement effect against population samples 
of medium vehicle audiences. 

The typical divorce of media and copy or moti- 
vational research in advertising agencies, the fre- 
quent ignorance of copy or motivational research 
in the research departments of the leading media, 
and the late dawning of advertising research ac- 
tivity in many advertiser organizations have all 
combined against the development of completely 
rounded media researchers. 

A basic viewpoint of this paper is that qualitative 
media value should be defined in relation to the 
overall effect of advertising and in interaction with 
specific advertising copy. Given this perspective, it 
is argued that research within this area must pro- 
ceed not only from a theory of how media works, 
but also from a theory of how advertising copy 
works and how these two combine to work to- 
gether. Media researchers have not traditionally 
been developed and trained to handle problems 
within these dimensions. 

Second, expansion of media research beyond the 
important quantitative studies now available is in- 
evitable. In the process, the melding of all current 
tangents of advertising research is also inevitable. 
The next developments in media research must 
come from increasingly rigorous measurement of 
qualitative media effect. If such studies, carefully 
conceived and executed with fully representative 
samples of medium or vehicle audiences, reveal 
important differences between media vehicles in 
their qualitative contribution to media effect, im- 
portant gains in the planning of advertising eff- 
ciency will be made. 
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One can hope that media studies of the immedi- 
ate future will be designed to demonstrate the pres- 
ence or absence of qualitative media effect rather 
than merely reiterating the known competitive dif- 
ferences between media vehicles already absorbed 
into the media planning processes. 
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Another Look at 
Two Instant Coffee Studies 


ConraD R. 
University of Nebraska 


Professor Hill suggests that direct and indirect questions both have 
limitations in consumer research because answers to both are likely 


to be rationalizations. 


UDGING FROM THE MOMENTUM of published re- 
ports, the use of motivation research as an ad- 
vertising tool has languished considerably since the 
faddish frenzy of the early fifties. Despite this grad- 
ual fade-out, one—Mason Haire’s study of instant 
coffee—continues to stand out and earn kudos and 
footnotes from research writers (Selltiz et al, 1959). 
The purpose of this article is to assess this “classic” 
article (Westfall, Boyd and Campbell, 1957, p. 135) 
so far as practical advertising and marketing prob- 
lems are concerned. 

Haire’s premise is that advertising research meth- 
ods which rely exclusively upon direct questioning 
of consumers usually elicit mere rationalizations 
about product attributes. Therefore, in order to 
uncover the more important but latent attitudes, 
projective techniques are required. 

Haire suspected that “dislike for the flavor of 


CONRAD R. HILL is assistant 
professor of journalism at the 
University of Nebraska. After ob- 
taining his B.A. in journalism 
from the University of Michigan 
in 1950, he worked as an adver- 
tising executive for Sparks-With- 
ington, Grey Advertising and the 
Atomic Research Corporation. He 
received an M.A. in communica- 
tions from Stanford in 1957 and 
has since taught at the Universities 
of Missouri and North Carolina. 
His first book, The Aberrant Im- 
age of Advertising, was published this year by the Univer- 
sity of Nebraska Press. 
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instant coffee” was just a ready rationalization. To 
test this notion he showed different grocery lists to 
two groups of 50 housewives each. Group One was 
asked to describe the housewife who made up the 
following shopping list: 
“Pound and half (sic) of hamburger 

Two loaves of Wonder bread 

Bunch of carrots 

One can Rumford’s Baking Powder 

Nescafé instant coffee 

Two cans Del Monte peaches 

Five pounds potatoes” (Haire, 1950, p. 651) 

Group Two was asked to describe a housewife 
who made up a list identical to that above except 
that “Maxwell House Coffee (Drip Grind)” re- 
placed ‘“‘Nescafé instant coffee.” 

Before recapitulating Haire’s findings in Table I, 
let’s take a closer look at the suspected cultural 
stereotype that Haire discusses—dislike for the fla- 
vor of instant coffee. His respondents were asked, 
“Do you use instant coffee?” If the answer was 
“No,” they were then asked, “What do you dislike 
about it?” Obviously this question introduces bias 
because it assumes that non-users are non-users due 
to dislike, which may or may not be true. 

A better question would have been, “Have you 
used instant coffee within the past week?” or some 
other question that would have avoided the defen- 
sive sting of a direct accusation. What’s more, Haire 
should have asked for likes as well as dislikes. Fail- 


ure to look at the other side could. load his data. 


seriously. 
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As Haire’s Table 1 shows, “flavor” as a deter- 
minant of respondents’ underlying attitudes toward 
instant coffee failed to arise in the depth situation. 
Instead, attitudes were pitched in terms of value 
judgments about the shopper. This is not surprising 
because that is what he asked for. The instant coffee 
shopper is viewed as lazy and as failing to plan her 
household duties and purchases. On the other hand, 
the regular coffee woman shines with the positive, 
culturally approved, housewifely virtues. Haire’s 
follow-up pantry check revealed that instant users 
tended to be more tolerant of the instant coffee 
shopper, whereas the non-users were more negativ- 
istic. From these findings, Haire concluded that 
these “underlying attitudes” influence the decision 
to buy or not to buy instant coffee, that the only 
way to unearth these important attitudes is by pro- 
jective research, and that direct questions cannot 
bring forth the “real” information so necessary for 
effective advertising campaign appeals. 

As this critique suggests, that is one whale of a 
supposition. Negative attitudes toward sinners do 
not prevent most of us from sinning; negative at- 
titudes toward instant coffee may not prevent us 
from buying it. 


Comments on Methodology 
Haire’s failure to describe his sample design 
makes it difficult to assess the validity of his com- 
putational methods. Overlooking this basic con- 
sideration, there are other methodological ques- 


The woman who buys Nescafé is seen as: 
Economical+ 
Not economical 
Can not cook or does not like tot 
Plans balanced meals* 
Good housewife, plans well, cares about family+ 
Poor housewife, does not plan well, does not care about family* 


Lazy* 


population whose true difference is zero. 


‘tween the groups. 
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TABLE 1 
MENTIONS BY USERS AND NON-USERS OF INSTANT COFFEE 
(AFTER HAIRE, 1950) 


*An asterisk indicates that differences this great would be observed only five times out of 100 in repeated samplings of a 


tions that may be legitimately raised. Even if we 
grant that attitudes toward instant coffee and in- 
stant coffee users are synonymous—which they are 
not—Table 1’s presentation suggests other weak- 
nesses. 

Because the Table 1 presentation offers gross 
analysis, it doesn’t really tell us very much. Needed 
are determinants of relationships between the at- 
titudes of users and non-users by age, income, fam- 
ily size and so forth. This is impossible with a sam- 
ple of 50, because there are not enough respondents 
for the cells demanded in cross-tabulations. In other 
words, it is statistically unwise to draw conclusions 
and inferences from two respondents per cell. 

As for the pantry check, we learn there were 32 
users and 18 non-users of instant coffee. Projecting 
that ratio to the universe as Haire did with other 
findings, are we to assume that instant coffee en- 
joyed 64 per cent market penetration in 1950? 

Another methodological criticism involves the se- 
lection of classes in Table 1’s stub. Do these meet 
the research criterion of being mutually exclusive? 
For instance, could it be that “good housewife, 
plans well, cares for her family” and “plans bal- 
anced meals” represent a single “planning” dimen- 
sion, and not two as Haire suggests? In other words, 
do they overlap? 

If so, then the findings may be heavily loaded 
with articulate respondents, that is, those who 
harped on the same theme with only slight varia- 
tions. Additional discussion of this aspect follows. 


By Women 
Who Had 
Instant Coffee 
in the House 


By Women Who 
Did Not Have 
Instant Coffee 
in the House 


(N = 32) (N = 18) 
Number Per Cent Number Per Cent 
22 70 5 28 
0 0 2 ll 
5 16 10 55 
9 29 2 1] 
9 29 0 0 
5 16 7 39 
6 19 7 39 


tA dagger indicates that the chances are one in 100. We are justified in rejecting the hypothesis that there is no difference 
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TABLE 2 


FAVORABLE AND UNFAVORABLE MENTIONS BY USERS AND NON-USERS OF INSTANT COFFEE 
(REVISION OF HAIRE’S TABLE 1) 


By Women Who Had 
Instant Coffee 
in the House 


By Women Who Did Not 
Have Instant Coifee 
in the House 


(N = 32) (N = 18) 
PerCent of Per Cent of PerCentof Per Cent of 
The woman who buys Nescafé is seen as: Number Subjects Mentions Number = Subjects Mentions 
Economical 22 69 (39) 5 28 (15) 
Good housewife, plans well, cares about family, 
plans balanced meals 18 56 (33) 2 1] (6) 
Total Favorable Mentions 40 125 (72) 7 39 (21) 
Not economical 0 0 (0) 2 11 (6) 
Lazy 6 19 (10.5) 7 39 (21): 
Poor housewife, does not plan well, does not 
care about family 10 31 (17.5) 17 95 (52) 
Total Unfavorable Mentions 16 50 (28) 26 145 (79) 
Total Mentions 56 (100% 33 (100°) 


Because Haire’s objective was to reveal the pres- 
ence of underlying attitudes toward instant coffee, 
Table 2’s division of responses into favorable and 
unfavorable categories seems better suited for anal- 
ysis. Note particularly the bracketed percentages 
listed under “Per Cent of Mentions.” Rather than 
base respondent mentions upon the N of respond- 
ents, the new base is taken as the total mentions 
made by both users and non-users. In this manner 
it is possible to compare relationships between the 
groups. As Table 2 indicates, they are not as dra- 
matic as those in the original presentation. 

The average number of mentions by non-users 
(33 by 18) and by users, of instant coffee (56 by 32) 
is roughly equal at 1.8 per respondent. In order to 
assess that statistic, however, we need to know the 
ranges as well. That is, did a small but vocal minor- 
ity contribute the bulk of the mentions to the detri- 
ment of a larger but mute group? Such a statistic 
would provide clues for an understanding of the 
attitude classes in Table 1’s stub. ; 


Bias By Baking Powder? 

Refer back to the grocery list used. Note that 
Rumford’s Baking Powder immediately precedes 
the coffee item. Is it possible that baking powder, 
as a symbol of the good cook, could have subtly 
biased the responses? It may have exerted a strong 
“contrast effect” so that instant coffee assumed a 
shameful role in obvious contradiction to the stereo- 
type of what constitutes a good cook. 

An analysis of respondents’ verbatim reports pub- 
lished by Haire augments that suspicion. That is, 
in the ambiguous evaluative situation, respondents 
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seem to have searched the list for items to serve as 
guides. For example, one respondent resolved her 
ambiguity in this fashion: 


“...she must like to cook and bake as she included 
baking powder. . . .” 


Another rationalized baking powder in terms of 
other items: 


. . canned peaches, instant coffee ... all the items 
with the exception of Rumford’s are easily prepared items.” 


It seems safe to conclude that baking powder did 
prejudice the case against instant coffee, but it is 
impossible to know to what extent. 


Westfall, Boyd and * .mpbell Study 
This second study of attitudes toward instant 
coffee was conducted seven years later by the above 
Northwestern University researchers. After first 
qualifying respondents as to recency of coffee-mak- 
ing, they asked: 


“|. . the last time you made coffee—did you use perco- 
lator, drip method, vacuum method, instant coffee, or some 
other method?” 


Next they asked respondents to match 19 person- 
ality dimensions (the best cook you know, the worst 
cook you know, etc.) to each of the coffee prepara: | 
tion methods. This technique, the authors sug: | 
gested, would reveal underlying attitudes toward 
instant coffee. 

Generally, their findings agree in direction but 
not degree with Haire’s. For example, “dislikes 0 
cook,” “thrifty,” “cares for family” and “good 
planner” proved to be in good agreement. But | 
Westfall’s “poor cook” dimension had_ smaller 


JOURNAL OF 


ADV 


for 
ent. 
nes: 
4 
sim 
elic 
cial 
ge 
tion 
que 
eral 
have 
T 
| 
also. 
i 
is, t 
cult 
on ¢ 
Wh: 
ratic 


ent of 
tions 


i) 

1): 

0%) 


"Ve as 
d her 


cluded 


ms of 


items 
items.” 
or did 


Astant 
above 

first 
>-mak- 


perco- 
yr some 


erson- 
worst 


epara: | 
s sug: 
oward | 


yn but 
kes to 


“good 


t. But 


maller 


AL OF 


differences between users and non-users than did 
Haire’s. Surprisingly, “laziness” proved to be similar 
for users and non-users of instant coffee in Westfall’s 
findings. 

This last finding, contradicting as it does expecta- 
tions that users and non-users should react differ- 
ently to “lazy” attitudes, suggests a common weak- 
ness of forced choice research techniques. There’s 
simply no way of knowing to what degree forcing 
elicits rationalizations rather than true attitudes. 
And unless attitude intensity is measured, superfi- 
cial responses must be accepted as equally valid as 
expressions of rigid attitudes. Consequently, the 
“laziness” dimension may be as much a rationaliza- 
tion as “dislike for flavor.” 


Force of Habit 

Despite projective researchers’ apparent ability 
to reveal underlying attitudes that are ostensibly 
more sophisticated than those elicited by direct 
questioning, there is no basis upon which to evalu- 
ate the worth of those “revealed” attitudes. In sev- 
eral reported studies, different researchers probing 
for underlying attitudes about identical products 
have unearthed disparate findings. 

Therefore the suspicion emerges that these so- 
called underlying attitudes may be rationalizations 
also—but at a slightly more sophisticated level; that 
is, they may be less ready rationalizations about 
cultural stereotypes that do not necessarily impinge 
on decisions to buy or not to buy a given product. 
What’s more, these underlying attitudes may be 
rationalizations for habitual or routinized behavior. 


Pursuing this notion of habit, we know that 
psychology has well documented the fact that re- 
sistance to change usually increases with age. There- 
fore, in order for advertising researchers to assess 
properly opportunities for new products, or to un- 
derstand their share-of-the-market for established 
products, they should consider seriously, much more 
seriously, the workings of neophobia (fear of the 
new) as a sales deterrent. This assumes sharper 
meaning if we remember that one objective of ad- 
vertising established impulse items is to reinforce 
conditioned brand responses. Therefore, research 
for any brand in a given product line needs to 
measure as accurately as possible the drag of previ- 
ous conditioning and how that drag is distributed 
among competitors market by market. 

This is to suggest, then, that Haire and Wesifall 
failed to tap anything of significance so far as “true 
attitudes” toward instant coffee are concerned. Both 
studies made it easy for respondents to report super- 
ficial attitudes that may actually represent the 
weight of habit, not subconscious attitudes as im- 
plied. It is hoped that this suggestion casts the con- 
cept of depth research into a new focus. 
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“Sir—In your issue of December 31 you quote Mr. B. S. Morris as saying that 
many people are disturbed because about half the children in the country are 
below average in reading ability. This is only one of many similarly disturbing 
facts. About half the church steeples in the country are below average height, 
about half our coal scuttles below average capacity, and about half our babies 
below average weight. The only remedy would seem to be to repeal the law of 


averages. Yours faithfully, etc.” 


—LETTER TO THE EDITOR OF THE Times, LONDON, JANUARY 1954. 
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Letters 


Comment on “How Incentives and Subsamples Affect 
the Precision of Mail Surveys” 


Jack B. Haskins 
The Curtis Publishing Company 


HIS JOURNAL “‘is intended for practitioners and 
Tease of advertising research” and from this it 
may be inferred that the papers should therefore be 
practical and usable. Also, “reports of findings are 
favored over theoretical discussion.” While this 
should not be narrowly interpreted, theoretical dis- 
cussion should be translated into terms that have 
some relevance to the work of advertising research- 
ers. 

The subject article (published in this Journal, 
Vol. 1, No. 1, September 1960) can be criticized on 
both those grounds as well as on a more serious 
one, the validity of the findings. 


1. Under the conditions of the two surveys re- 
ported, it is impossible to make any valid com- 
parison of relative costs or relative effectiveness 
of the techniques involved. 

2. Some rather specialized usages of such terms as 
“precision,” “information” and “effective re- 
sponse rate” are put forth which, if not irrele- 
vant to the topic at hand, are ineffective as com- 
munications to the reader of the article. 

3. In general, the article is not clear on the answer 
to the question, “How do incentives and sub- 
samples affect the precision of mail surveys?” 


Each of these points is discussed in more detail 
below. 


Validity 

One stated objective is “to compare the two pro- 
cedures in terms of the amount of information ob- 
tained per dollar spent to collect it.” In order to 
make such a comparison, it would be necessary to 
hold all other factors constant except the financial 
incentive, under the present design; this would not, 
of course, be necessary in the case of some other de- 
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sign, such as a factorial experiment, where several 
factors could be tested at once. In this study, there 
are several other things which varied and which 
confound the results in terms of the stated objec- 
tive. 


a. The studies were conducted in different years. 
The composition of the population had changed 
during the four years between studies, along 
with possible other broad social changes. These 
differences could conceivably produce differing 
response rates to mail questionnaires, independ- 
ently of the incentives used. 

b. The questionnaires were different, although 
judged by the investigator to be “comparable in 
length and complexity. . . . Some topics were 
added in the 1960 study and it was decided to 
split the sample and ask certain questions of 
half the sample only.” Differences in questions 
asked could certainly influence the response rate. 

c. An advance postal card was sent to the 1960 
sample. Methodological studies by The Curtis 
Publishing Company demonstrate that an ad- 
vance postal card can increase the number of 
returns (as well as the quality of returns in terms 
of predictive value). 


This, then, is a comparison of results from two 


studies which differ not only in respect to the finan f 


cial incentive, but from at least three other factors 
which confound the results so that no definite com- 
parative statement can be validly made about the 
effects of the incentive, nor about the costs attribut- 
able to it. This, incidentally, is the Achilles heel of 


another popular statistical maneuver, the multiple j 


regression analysis of historical data, in which no 
amount of statistical manipulation can overcome 
the confounding of variables in the original data. 
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Semantics 

Several terms are used which appear to be either 
inappropriate or poorly defined. 

“Effective response rate” is defined as “the per- 
centage who replied to the first mailing, two times 
the percentage who responded to the second mail- 
ing, and four times the percentage who responded 
to the third mailing.” Actually, this is the “pre- 
dicted response rate if all non-returnees had _ re- 
ceived additional mailings.” (Incidentally, the ar- 
ticle shows 1956 as being somewhat better than 
1960 on this statistic, whereas 1960 was actually 
somewhat better than 1956 when the arithmetic is 
corrected.) 

“Precision” is used frequently but not defined. 
According to one source (Palmer O. Johnson, Sta- 
tistical Methods in Research, New York: Prentice- 
Hall, Inc., 1949), precision is the amount of in- 
formation which a particular experiment affords. 
“Efficient” is also used but not defined; Johnson 
defines an efficient estimate as one whose sampling 
distribution tends to the normal law with the least 
possible standard error as the number of observa- 
tions is increased. Just how relevant this statistical 
kind of “precision” and “efficiency” is to the topic 
at hand is not stated. In any event, they are some- 


what removed from the working language and re- 
quirements of advertising researchers; the same can 
be said of the term “amount of information” which 
is defined as the reciprocal of the variance of an 
estimate. This is not to say that these terms are ir- 
relevant, but that their relevance is not made clear. 


Relative Cost 

The statement is made that “At first sight the 
collection costs involved in the 1960 study would 
seem to be much greater than in the 1956 study.” 
But the 1956 study produced 5,288 responses at a 
cost of $11,980 or $2.27 per returned questionnaire; 
the 1960 study produced 6,347 responses at a cost of . 
$12,471 or $1.96 per returned questionnaire. To 
produce a given number of responses, the 1960 
study is obviously cheaper. 


Conclusion 

Apart from these deficiencies, one other scientific 
principle should be considered and that is the law 
of parsimony, which is to say that one should choose 
the simplest method possible to describe a given 
phenomenon. In an applied field such as this, and 
in this Journal, parsimony is even more important 
than in the academic field. 


Rejoinder 


LesTER R. FRANKEL 
Audits and Surveys Company 


. eee POINTS RAISED in the comment on my ar- 
ticle can be grouped into five general classes. 
These are: 


. The article is too theoretical. 


ro 


The article is neither practical nor usable. 
3. The development of the thesis is invalid. 
4 


. The article is deficient on technical grounds 
such as, for example, incorrect usage of statistical 
terms and an error in arithmetic. 


- Miscellaneous points, such as (a) the article at- 
tempts to use statistical manipulations similar to 
those used in multiple regression analysis of his- 
torical data to overcome the confounding of 
variables and (b) the selection of the article for 
publication by the editors violates “the law (sic) 
of parsimony.” 


I shall discuss each of the first four points and 
ignore the fifth. 
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Point 1 

The critic is explicitly concerned about the ar- 
ticle because of its use of theory. In addition, much 
of his criticism appears to be dominated by a re- 
luctance to accept theory as a basis for practical 
guidance. Without the acceptance of theory an ex- 
periment could only be conducted for its own sake. 
The best that could be achieved with this philos- 
ophy in a mail questionnaire experiment to test 
alternative techniques would be to use trial and 
error tests and come up with a decision as to what 
would have been the best technique. Without a 
theory the utilization of even these results at a dif- 
ferent time or with a different questionnaire would 
be impossible because the conditions would not be 
identical. 

Point 2 

It is claimed that the article is neither practical 
nor usable. Theory is always abstract; but the test 
of good theory is its eventual application. By this 
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standard the article certainly passes the test. From 
our theorizing we were able to get more informa- 
tion (as defined by sampling statisticians) for our 
money. Surely this is practical. 


Point 3 

It is claimed that the method used to develop the 
thesis of the article is invalid. The specific criticism 
against the approach is that the 1956 and the 1960 
studies cannot be compared because of (1) differ- 
ence in time, (2) different questionnaires and (3) 
the use of preliminary post cards in the 1960 but 
not in the 1956 study. Naturally, the post card vari- 
able was not present in 1956. This, together with 
the 25-cent incentive in the first mailing, was intro- 
duced by design into the 1960 study. The fact was 
clearly stated in the article; first in the paragraph 
of the text of the article which described the in- 
centive program, and second in Table 2 when the 
cost of the post card mailing was included with the 
incentive costs. It appears that the original state- 
inents in the article were deliberately misconstrued 
to form a basis of an attack. To becloud the issue 
still more the critic has on his own initiative in- 
troduced the word “financial” prior to incentive to 
give the impression that post cards were not part 
of the incentive program. 

It is reasonable to assume that the two studies 
were comparable in spite of the differences in time 
and in the questionnaires. In both studies three 
questionnaire mailings were made;.a_five-dollar 
cash incentive was used in the third mailing and al- 
most identical over-all sample representations were 
obtained. The effect of the added incentives in 
1960 was to accelerate the responses among those 
persons who would eventually respond. 


Point 4 

It is claimed that the article has many technical 
shortcomings such as the incorrect usage of certain 
statistical terms and an error in arithmetic. As a 
field develops a technical vocabulary evolves. Its 
terms become symbols for ideas, concepts and op- 
erations. When a new field develops from in old 
one, it is natural that many of the earlier terms 
should be carried over. So it is with sample survey 
methods which have developed irom statistical the- 
ory. Many terms retain an identical meaning; 
others are used in closely similar senses. The exact 
meanings of its terms can, of course, easily be found 
in books on sampling, as for example: Hansen, 
Hurwitz and Madow, Sample Survey Methods and 
Theory and Deming, Some Theory of Sampling. In 
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writing an article on some aspect of survey sam- 
pling the author would naturally use the terminol- 
ogy of survey sampling. If certain of the terms are 
in general usage by potential readers of the article 
these terms are not defined. If other terms are used 
to a lesser extent, or if certain new terms are intro- 
duced, definitions are given. 

In this area my use of the terms “precision” and 
“efficient” are questioned. It is claimed that neither 
term was defined (actually the word “efficiency” 
was defined) and that the relevance of these terms 
is not established. The critic then attempts to de- 
fine these terms. However, instead of obtaining 
these definitions from a standard text on sampling 
he refers to a book on statistical methods. It hap- 
pens that the word “precision” has almost the iden- 
tical meaning in sampling as it does in the defini- 
tion which is cited. If the critic concedes that a 
mail questionnaire survey is, in effect, an experi- 
ment, then the use of the term “precision” under 
his definition is relevant. The term “precision” in 
books on sampling may have reference to any sam- 
pling process where probability methods of selec- 
tion are used. 

The danger of going outside of a particular field 


-of application for definitions is illustrated when 


texts on sampling are bypassed by the critic in 
seeking the meaning of the word “efficient.” He 
misses the point when he cites a definition of an 
“efficient estimate.” This definition, due to R. A. 
Fisher: and widely accepted by statisticians, refers 
to a criterion for selecting a formula to predict pop- 
ulation parameters from corresponding sample sta- 
tistics. In this sense of the word, the “efficient” for- 
mula is the one which predicts the parameter with 
least variance for a fixed sample size. For example, 
in most cases the arithmetic mean is to be preferred 
over the median as an estimate of the mean of the 
population. No wonder Mr. Haskins has difficulty 
in seeing the relevancy of this concept to the opera- 
tion of mail surveys. 

All of the computations have been rechecked and 
no arithmetic errors were found. 


* * * 


I have no fear that advertising researchers will 
encounter conceptual or technical difficulties in 
reading the article. Most advertising researchers are 
versed in the scientific method; they have a healthy 
respect for theory; they are familiar with current 
sampling terminology; they are able to reason cor- 
rectly; and finally, they are willing to learn from 
the experience of others. 
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FEDERAL STATISTICS 
IN ADVERTISING 


Incrip C. 
ARF Research Statistician 


HE FEDERAL CENSUS OF 1870 was the first to use 
se tallying machine—data from the previous 
eight censuses were tabulated 
by hand. Twenty years later 
electrical tabulation ma- 
chines were introduced, but 
they were a far cry from 
1960’s data processing equip- 
ment. Today, with the help 
of high speed computers and 
printers, the Bureau of the 
Census is producing the re- 
sults of the decennial census 
more rapidly than ever before. This added speed 
will enhance the value of census data to those who 
want to know more about their markets. 


Small Area Statistics 

Especially valuable will be the tabulations of 
data from small geographic areas. In previous years, 
most of such information was out of date by the 
time it was offered. Available while still current, 
these smal] area statistics will be useful to describe 
the people that compose the local market. 

Different neighborhoods within a city obviously 
have different market potentials. The advertiser 
who wants to reach a specific segment of the market 
will find it profitable to compare living conditions, 
economic status or other characteristics of these 
areas. He could even combine them to correspond 
with his company’s own sales districts. A map 
showing actual sales by district, and those popula- 
tion or housing characteristics relevant to sales, 
would be a valuable device for evaluating sales per- 
formance, setting sales quotas or planning product 
distribution. 

More Efficient Samples 

With the increased use of consumer or house- 
hold surveys, it is important to the advertiser that 
his samples be planned efficiently and economically. 
Here the survey designer will find small area sta- 
tistics a valuable resource. Suppose he wants to 
measure the penetration of an advertising campaign 
in a test city. He selects a sample, first using the 
census data to stratify blocks according to popula- 
tion characteristics. He numbers the blocks on a 
city map and selects a prescribed group from 
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each stratum. He then designates the households 
(or perhaps a subsample of the households) in the 
sample blocks for the interview. With the materials 
available from the Census Bureau, designing an 
efficient sample is relatively simple and inexpensive. 

Here are some of the areas for which these mate- 
rials will be furnished. 

Census Tracts 

For statistical purposes, large cities have been ar- 
bitrarily divided into small geographic areas. At 
present there are 23,000 such census tracts, nearly 
twice as many as in 1950. The 175 places “tracted,” 
each with one or more cities, include most U. S. 
cities over 50,000 in population. ‘The average tract 
has a population of about 4,000. Local committees 
set boundaries that make tracts homogeneous in 
population and housing characteristics. Boundaries 
are permanent: even if a tract is subdivided the 
resulting smaller tracts are still contained in the 
original. Thus changes over time can be analyzed. 

Tract reports scheduled for May through Septem- 
ber 1961 will include population by age, education, 
color, sex, marital status and relationship, occupa- 
tion, family income, means of transportation to 
work, average rent, property value, number of 
rooms, persons per room, condition of plumbing, 
etc. Photostats of advance data are now available 
at $3.50 per 100 tracts. 

City Blocks 

These statistics will be published in a series of 
about 500 reports from March through August 
1961. Population and housing data, reported in 
some of the same ways as census tracts, will be 
shown by city blocks for each city where the last 
official census count was 50,000 or more, and for 
about 250 places included by special request. Maps 
will be provided on which the blocks can be lo- 
cated. 

Enumeration Districts 

“ED’s” are the small areas determined by the 
Bureau especially for the decennial censuses. In 1960 
there were 275,000. Their populations range from 
a few people to two or three thousand, and average 
about 700. Data are not published for individual 
enumeration districts, but anyone may obtain at 
nominal cost photocopies of final population and 
housing counts along with maps showing district 
boundaries. Some time in 1961, summary cards or 
tapes of the ED data will be prepared and offered 
at cost. 

Further information and cost estimates are avail- 
able from the Director, Bureau of the Census, De- 
partment of Commerce, Washington 25, D. C. 
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RESEARCH IN REVIEW 


Gwyn THornton C. Lockwoop and GEORGE M. SHIREY 
ARF Research Associates 


Sampling Made 
Palatable 


W. Edwards Deming. Sample Design in Business Re- 
search. New York: John Wiley & Sons, Inc., 1960, 
$12.00. 

This book is of major importance to advertising 
researchers. Although Professor Deming maintains 
in his preface that it is a textbook written from the 
viewpoint of a theoretical statistician it is a more 
lively, more interesting and more individual book 
than his description suggests. 

Divided into three unequal parts, it is at once a 
manifesto, a handbook and a text. A memorable 
introduction deals with the statistician’s function 
as Professor Deming sees it. He describes the re- 
sponsibilities and duties of the statistician to his 
client or employer in a chapter which is a statisti- 
cian’s bill of rights. Probably the consulting statis- 
tician will find it easier to operate within Professor 
Deming’s rules of operation than will the salaried 
statistician. This chapter can be read with profit 
by all who have and all who give statistical help. 

The remainder of the first part of the book is de- 
voted to an eminently sensible discussion of the 
materials with which sampling statisticians must 
work. This constitutes a reversal of the method of 
many texts on applied statistics which first develop 
the theory and introduce the reader to the facts of 
life later. Professor Deming first lays a foundation 
of common sense on which to build later and more 
abstract ideas. 

The second part of the book introduces replicated 
sampling. Basically the method consists of collect- 
ing data from several subsamples and treating the 
subsamples separately instead of working with one 
large sample. The procedure has become increas- 
ingly popular, and the author mentions that he has 


used it exclusively since 1948. This book offers the - 


most detailed description of the method and its ad- 
vantages currently available. Even those who are 
easily discouraged by simple statistical theory will 
find Professor Deming’s discussion of this method 
easily understood and the method attractive. The 
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procedure is illustrated in great detail with some 
well chosen examples. 

The third part of the book is theoretical and ex- 
plains many of the ideas which have been intro- 
duced in earlier sections. Sampling is an applied 
science and as such it must draw on many results 
and theories derived from probability and statisti- 
cal inference. In the brief space available to him, 
Professor Deming has therefore had to take a good 
deal for granted. Moreover, he has not aimed at 
covering every point of the relevant statistical 
theory, but has concentrated his energy on a few 
important topics. After developing the idea of ex- 
pected value and some theory of variances he has 
a note on some distributions of rare events and a 
method for transforming them into a more familiar 
form. He has also a brief and lucid account of the 
theory underlying the best selection of strata for 
stratified sampling. 

This partial listing of the contents of this book 
may be misleading. It is not a conventional sam- 
pling cookbook. Professor Deming is one of the 
most widely known consulting sampling statisti- 
cians, and his experience in this field has been 
lengthy and diverse. In this book he shares much of 
it with the reader. It is in some ways a professional 
autobiography and includes much illustrative ma- 
terial of sampling practices, both good and bad. 
The author has made this a better book by expos- 
ing something of himself in this unlikely vehicle, a 
statistical text. 

It should be said too that his account of sampling 
practices is written from a definite point of view: 
that of replicated sampling. There are other sam- 
pling methods but for them the reader will have to 
turn to such standard texts as Sample Survey Meth- 
ods and Theory by Hansen, Hurwitz and Madow. 

Something should be said about the mathematics 
the reader needs in order to understand this book. 
The first part of the book is completely unmathe- 
matical. The second part can be read with only 
high school mathematics. The third part makes no 
great extra demands, but will be read more easily 
by those with rather more algebra and some calculus. 
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About half a dozen well known texts currently 
delineate the field of sampling statistics. This is a 
significant addition to them. It should be on and 
off every researcher's book shelf. 


—Gwyn 


Persuasion on 
the Procrustean Bed 


_ Herbert I. Abelson. Persuasion: How Opinions and At- 
titudes Are Changed. New York: Springer Publish- 
2X- ing Co., Inc., 1959, $3.75. 
ro- Procrustes, you may recall, was the legendary 
ied robber who stretched or trimmed his victims to fit 
Its upon an iron bed. The critic who decries the dis- 
sti- organization of research findings is usually the first 
im, to accuse anyone who tries to organize them of us- 
od ing Procrustean techniques. In the face of such in- 
at evitable criticism the author is to be congratulated 
cal on this attempt to provide a framework for explor- 
few ing the psychological bases of persuasion. 
ex- Dr. Abelson has drawn extensively upon the liter- 
has ature of the social sciences to reach 24 conclusions 
da grouped in five chapters: how to present the issues, 
liar the influence of groups, the persistence of opinion 
the change, the audience as individuals and the per- 
for suader. His purpose is to weigh the factors responsi- 
ble for the success or failure of attempts to persuade 
ook people. 
am- The advertising researcher is likely to be in- 
the trigued at the prospect of such an undertaking but 
isti- disappointed before completing the first chapter. 
wane Conclusion number two states that “When opposite 
h of views are presented one after another, the one pre- 
mal sented last will probably be more effective.” It is 
atl supported by results of four experiments. The Or- 
bad. der of Presentation in Persuasion, edited by Carl I. 
Pos- Hovland, and one of the 139 entries in Dr. Abelson’s 
le, a bibliography, states this principle somewhat differ- 
ently: “When two sides of an issue are presented 
ling successively by different communicators, the side 
iew: presented first does not necessarily have the advan- 
sam- tage.” Dr. Hovland’s conclusion is followed by re- 
1e to sults of eight experiments in which the relative 
feth- effectiveness of first and last communications varied 
dow widely depending on the experimental conditions. 
atics None of these eight studies is cited by Dr. Abelson. 
ook. The author does recognize the danger of inter- 
athe- preting such research data too broadly, warning 
only that slightly different experimental conditions might 
»5 no prodiice different results. He properly notes that his 
-asily material “should be regarded by the reader as some- 
ulus. thing to compare with his own experience, rather 


ADVERTISING RESEARCH 


than as a substitute for experience.” ‘The reader will 

be struck nevertheless by the use of fairly pat an- 
swers when highly qualified interpretations seem 
more in order. The author only partially succeeds 
in reducing this impression in the discussion section 
which follows each conclusion and its research 
support. 

The detailed descriptions of 62 specimen studies 
are of considerable value, but there is one important 
omission. The people studied are identified as stu- 
dents in 25 studies, as soldiers in six, but in 20 
cases are not described at all. 

Although the preface holds out some hope that 
opinion and attitude change data relevant to the 
advertiser will be included, only four of the studies 
can be considered to concern product-oriented at- 
titude change. Foreign policy, domestic government 
and non-government issues, and various issues con- 
cerning attitudes of small groups dominate the 
topics cited in support of attitude change. 

We may ask, at this stage of development in the 
science of persuasive arts, whether summaries 
should be attempted at all. The answer must be an 
emphatic “yes” if only because they, like this vol- 
ume, present such a wealth of detailed and thought- 
provoking source material. Such organization of 
sources may be the most persuasive argument of all 
for more systematic research. 


—THORNTON C. Lockwoop 


Motivation Research: 
Lest We Forget 


Lawrence C. Lockley. Use of Motivation Research in 
Marketing. New York: National Industrial Con- 
ference Board Inc., 1960, $1.50 to NICB associates, 
$7.50 to non-associates. 

At the outset the author points out that enough 
time has now elapsed to permit an appraisal of the 
techniques used by the motivation researcher. Spe- 
cifically, his purpose in preparing this report was to 
describe these techniques, appraise their value, and 
indicate where and how they can be used to greatest 
advantage. 

More than a third of the monograph is devoted 
to descriptions of such techniques as the Thematic 
Apperception Test (TAT), paired pictures, sentence 
completion, word association and depth interviews. 
Each is illustrated by a practical application, al- 
though none is very detailed. 

Following this review is a section on suitable 
applications of motivation research. Dr. Lockley 
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points out that motivation research is ideal for do- 
ing the preliminary work necessary to design a large- 
scale study using more conventional survey methods. 
However, when the questions asked do not induce 
rationalizations, or when there are apparently no 
important associations in the preconscious or un- 
conscious mind with the product or service being 
studied, he concludes that psychological techniques 
serve no purpose. 

In his conclusion, Dr. Lockley notes that motiva- 
tion research itself is new only in its application to 
the study of why people react as they do to various 
marketing stimuli, and its success in this area has 
not yet been established., Important, and certainly 
stressed by Dr. Lockley, is the fact that very special 
skills are required to design and use psychological 
techniques in marketing and to interpret the data 
which result. 

The author suggests that the most appropriate 
uses of psychological motivation research are in de- 
veloping ideas, in searching consumers’ minds for 
motives that can be proved or disproved by further 
research, and perhaps in planning and pretesting 
advertising copy. 

Dr. Lockley’s paper is recommended for anyone 


who has not had the opportunity to read any of the — 


published material on motivation research and who 
would like a basic outline of this approach. But it 
adds little that is new to the published literature 
of motivation research. 

—GrorceE M. SHIREY 


Attitude Scaling 
at Loose Ends 


F. P. Kilpatrick and Hadley Cantril. Self-Anchoring 
Scaling, A Measure of Individuals’ Unique Reality 
Worlds. Journal of Individual Psychology, Vol. 16, 
No. 2, November 1960. 

“A self-anchoring scale is simply one in which 
each respondent is asked to describe, in terms of 
his own perceptions, goals and values, the top and 
bottom, or anchoring points, of the dimension on 
which scale measurement is desired, and then to 
employ this self-defined continuum as a measuring 
device.” 

The authors go on to maintain that it makes 
sense to compare respondents on the basis of goal- 
related variables with psychological meaning (such 
as striving, where one is now and will be a few 
years hence), but only if the individual’s “unique 
reality world” is taken into consideration. 


28 


The method consists of such things as open- 
ended probing, content analysis and non-verbal 
scaling. First, the respondent is asked to consider a 
dimension such as “way of life,” and then describe 
the best possible example of such a dimension. 
Probing is continued until the respondent can con- 
tribute nothing further. A description of the worst 
possible example of the dimension is similarly ob- 
tained. Second, the respondent is handed a picto- 
rial ten-point ladder scale and told that the best 
and worst examples he has just described should be 
regarded as end points on the scale. Usually the re- 
spondent is asked, ‘““Where on this ladder would 
you say you are now?” Past evaluations and future 
expectations can be obtained using the same scale. 
A third step may involve probing for reasons for 
different scale positions, 

Can the self-anchoring of one respondent be com- 
pared with the self-anchoring of another? The au- 
thors say yes: “The scale level selected by one 
person or group (average of selections) can be spe- 
cifically and meaningfully said to be higher, lower 
or equal to the scale level of some other individual 
or group, because the frames of reference of the. 
repliés are in fact similar psychologically.” The ar- 
ticle continues with comparisons of average rating 
scores on a personal “way of life” scale for each of 
five groups of adult Americans; on a national “as- 
pirations and fears” scale for each of seven groups 
of foreign parliamentarians; on personal and _na- 
tional “aspirations and fears” scales for Indian and 
American students; and on personal and national 
“aspirations and fears” scales for South African 
primitives. 

In all of the foregoing the authors seem to have 
missed an important point. A scale is simply a de- 
vice for generating numbers, usually one for each 
respondent. The problem is how to use these num- 
bers. Unfortunately, the authors apply this scaling 
device to “way of life” and “aspirations and fears” 
dimensions which appear to have no behavioral de- 
terminants in the real world. The authors’ mainte- 
nance of “psychological similarity” to justify av- 
eraging the scale levels of respondents highlights an 
undesirable influence in psychology: too much em- 
phasis on what the psychologist thinks he is doing 
and too little on what the respondent is doing. A1- 
vertising researchers who use or interpret this de- 
vice will be well advised to seek comparisons of the 
resulting scale numbers with actual behavior. 

Many readers would have been interested in an 
analysis of the dispersion of respondents’ self-rat- 
ings on the self-anchoring scale compared with 
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those obtained on a fixed scale such as the semantic 
differential. However, it would still remain to be 
proved that any differences obtained reflected dif- 
ferences in what was measured rather than simply 
the effects of different techniques. 

—THORNTON C. Lockwoop 


How Not to Lie 
with Statistics 


Joseph Alsop. The Wayward Press: Dissection of a Poll. 
The New Yorker, September 24, 1960, pp. 170-184. 

Bernard D. Nossiter. You’ve Never Been Quizzed by a 
— The Washington Post, October 16, 1960, 
p- 

Advertising and market research usually precedes 
some executive action. To verify the research is to 
check the stable doors after the horse has bolted. 
Often it throws good money after bad to make such 
checks and they are rarely called for. The Presiden- 
tial political polls are different. They provide, once 
every four years, a great public examination of the 
state of the survey art. 

Since 1948 the pollsters have been beset by un- 
believers, all ready to cry foul. Mostly they have 
been the enthusiastic supporters of some candidate 
who believes himself hurt by the results. Some have 
warned that published polls influence the vote. A 
minority of the critics consists of those who would, 
but cannot, see how the final poll figures are de- 
rived. For this minority, these excellent articles 
cast light into the dark places of polling methods. 

Mr. Alsop’s article may have been inspired by the 
surprising Gallup Poll of August 17 which found 
50 per cent of the electorate favoring Mr. Nixon, 
44 per cent favoring Mr. Kennedy, and only six per 
cent undecided. Everyone was disgruntled; Mr. 
Kennedy because he started too low, Mr. Nixon 
because he started too high, and the rest of us be- 
cause the six per cent figure seemed incredibly small. 
In tracing these figures to their source Mr. Alsop 
brings the spotlight to focus, in turn, on Dr. Gallup’s 
sampling methods, his weighting and adjusting 
processes, his record and his influence. 

Mr. Nossiter’s article makes splendid collateral 
reading. His is a detailed and illustrated account of 
how Dr. Gallup “deep fries, boils, roasts and sautés 
a mere 1,600 interviews.” Interestingly, Mr. Nos- 
siter concentrates on the poll of September 25 at 
which time, he says, Dr. Gallup’s method had been 
amended, apparently at Mr. Alsop’s suggestion. 

Up to now the publicity given to polling methods 
can best be described as creeping disclosure, or per- 
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haps progressive revelation. Certainly, it has never 
been easy for just any member of the public to find 
out where the published figures came from. This 
must be far from Dr. Gallup’s wish. He says that 
he has never refused to answer any question about 
his methods and that he has supplied editors who 
subscribe to his service full technical information. 
If this is so, then we must assume editors, naturally 
reluctant to serve up this less sensational aspect of 
polling, have not experienced much call for it. But 
dormant suspicions have now fed on so many polls, 
estimates and guesses that the time has come for 
explanations. Here, in the articles under review, 
are probably two of the best. 

Alsop and Nossiter give a good explanation of 
one of Dr. Gallup’s most misunderstood adjust- 
ments. Readers of this Journal will sympathize with 
his problem in having to predict not just the state 
of opinion generally but that of those people who 
are going to vote. Moreover, he must rely on good 
fortune to have the vote of the electoral college fall 
in the same direction or he runs the risk of more 
public outcry. So Dr. Gallup throws out of his sam- 
ple respondents he judges will not vote. These in- 
clude aliens, people who say they do not intend to 
register, and those who say they don’t intend to 
vote. These are more often Democrats than Repub- 
licans. It may not be the best way of sorting out the 
non-voters, and it certainly is not the only way, but 
it is defensible and Dr. Gallup does defend it. 

Both articles explain, too, the small numbers of 
undecided voters the poll finds. Dr. Gallup asks 
those respondents who describe themselves as un- 
certain which way they lean and in this way dis- 
poses of all but about six per cent who refuse even 
to lean. 

These two points are but examples of those 
touched upon in these articles. Not only do they 
answer those questions we were all asking recently, 
but they examine, too, why these questions were | 
asked and why answers were so long delayed. While 
Mr. Alsop complains of Dr. Gallup’s habit of “mys- 
tification,” Mr. Nossiter reports that Dr. Gallup 
complains of editors. Dr. Gallup maintains that 
he tries to tell all in six languages, in the technical 
journals and in popular descriptions. In addition, 
he says he thinks “basic” changes in technique 
should be reported. 

Messrs. Alsop and Nossiter agree that the poll- 
sters are honest men, an opinion we all can hardly 
fail to share. But it is evident that in these hard 
times one must not merely be honest but must 
readily appear to be so. In this latter effort Dr. 
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Gallup is apparently impeded by some of his sub- 
scribing editors. No blame can be placed on an il- 
literate or innumerate public. Mr. Alsop has shown 
how to make technical information more than just 
palatable in a popular magazine, and Mr. Nossiter 
has done so in a major newspaper. Let us hope that 
in 1964 all pollsters’ editors will profit from their 
example. —Gwyn COLLINs 


Two for Research: 
Schramm & Alderson 


C. H. Sandage and Vernon Fryburger (Editors). The 
Role of Advertising: A Book of Readings. Home- 
wood, IIl.: Richard D. Irwin, Inc., 1960, $8.00. 

Always valuable to the student is convenient 
access to a wide variety of papers relating to his 
subject. Collections of such material may be even 
more valuable to the “student” who has completed 
his formal education. 

With this in mind the editors have compiled a 
book of 49 papers by 42 individuals about five roles 
of advertising: in the economy, as communication, 
in society, in business and in social responsibility. 
Their purpose was to foster the development of a 
philosophy of advertising by bringing together pro- 
vocative statements of those who have contributed 
to its rational explanation. 

Although Messrs. Sandage and Fryburger would 
surely agree on the importance of research in under- 
standing advertising, the book does not dwell long 
on this facet. Research is represented by only two 
papers. Fortunately, they are both excellent: “The 
Effects of Mass Communications” by Wilbur 
Schramm and “The Productivity of Advertising 
Dollars” by Wroe Alderson. - 

Dr. Schramm reviews mass communications re- 
search since its birth some 25 years ago. Lazarsfeld’s 
early voting studies, his studies of personal influ- 
ence, later investigations carried out in psychologi- 
cal warfare, and opinion research in the armed 
forces and in advertising are given as evidence of 
what mass communication can and cannot do. We 
soon realize that it is severely limited in its capacity 
to change opinions, values or behavior. Research 
thus contradicts the advocates, well-represented in 
this book, of the position that advertising has be- 
come a major wielder of social control in America 
and that many are using this power irresponsibly. 

In contrast to Dr. Schramm’s paper, Wroe Alder- 
son presents theoretical approaches to two basic 
questions: How much should a firm spend for ad- 
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vertising? Given an advertising budget of a state 
size, how should the money be spent? 

Based on the principle that advertising is subject 
to the law of diminishing returns, Mr. Alderson 
shows how to develop an advertising productivity 
curve which can be used to determine the optimum 
size of a budget. Although the data often may be 
faulty and many problems exist in implementing 
proposed models, Mr. Alderson points out that 
these can be used to form a basis for relative judg- 
ment and a move in the right direction. 

The Role of Advertising contains many stimu- 
lating papers. A few are classics; many are familiar 
to the practitioner. Together they provide a useful 
supplement to standard texts. 

—GrorceE M. Suirey 


If You Can’t Audit, 
Watch the Purchase 


Earl E. Houseman and Benjamin Lipstein. Observation 
and Audit Techniques for Measuring Retail Sales. 
Agricultural Economics, Vol. 12, No. 3, July 1960, 
pp- 61-72. 

Retail audits have long been a standard pro- 
cedure for evaluating new consumer products and 
checking the progress of older ones. Although al- 
ternative and less expensive techniques have re- 
cently been much discussed, it is a safe bet that 
store audits will be with us a long time yet. 

The advantages of the method are obvious. A 
store inventory check, a record of dealers’ purchases, 
another inventory, a little arithmetic and we have 
sales. Each week, or month, or two months, regu- 
larly as clockwork the figures roll in. Unfortunately, 
not all the figures roll in; for some of the biggest 
stores refuse to cooperate though researchers may 
plead and cajole. 

From the ashes of these endeavors has arisen a 
new technique for getting the missing figures: that 
of actually observing consumer purchases within 
the store. In this paper Messrs. Houseman and Lip- 
stein explore the best way of doing it. They describe 
the measurement by the two techniques, observa- 
tion and audit, of the sales of apples and pears in 
the produce department of 60 stores in Philadel- 
phia. The two methods are compared for the pre- 
cision with which they estimated the week-to-week 
changes in sales. 

The authors point out that the two methods are 
not completely comparable in this way. Each pro- 
vides information which the other does not. For 
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example, the audit procedure gives inventory levels 
while the observation technique provides details 
of the number and nature of consumer purchases. 

When retail sales are measured in a city or some 
larger area the audit method usually uses only a 
sample of the stores in the area. Estimates of area 
sales will, of course, contain a sampling error be- 
cause the sample stores do not always exactly reflect 
the behavior of the other stores not in the sample. 
The observation method, too, is subject to this same 
sampling error and more, since usually only a sam- 
ple of each store’s business hours are observed. Gen- 
erally, then, we expect the observation technique 
to be less precise than the audit technique. But the 
cost of the two methods is not the same and the 
question arises, not which method is most precise, 
but which offers most precision for some fixed 
amount of money. 

The authors’ conclusions are quickly stated: the 
observation method is better for fast-selling products 
in large stores, and the audit method is better for 
slow-moving products or small stores. But there is 
more in this paper than just that. The methods 
considered for obtaining the best observation esti- 
mate—varying the length of the observation period; 
stratifying the hours available for observation by 
degree of consumer activity; and estimating product 
sales as a ratio of purchases of the product to pur- 
chases of all products—all these will help practi- 
tioners. The description of the experiment is clear 
and will be enjoyed by researchers of statistical 
bent. 

The significance of the paper is perhaps greater 
now than when this study was started in 1955. More 
and more stores refuse to cooperate in store audits 
and, unfortunately, these are the biggest and most 
important for sales estimates. Such stores not only 
have overwhelming sales volume but their sales pat- 
tern is often different, with private label brands 
playing a big part. 

Here Mr. Houseman and Mr. Lipstein have 
studied the perfect supplement to the audit. It 
flourishes in big stores where the audit has foun- 
dered. It thrives in busy periods which are anathema 
to audits. It adds a valuable dimension of informa- 
tion on the size of consumer purchases. 

This study brings into focus many of the promises 
and problems of the observation technique. The 
reader will also be grateful for the thoughtful notes 
added to the paper by Lester Frankel and Solomon 
Dutka. They provide an excellent summary of the 
special utility of several methods of measuring retail 
sales, —Gwyn COLLins 
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The Short Happy Lives 


of TV Commercials 


Schwerin Research Corporation. When Should the Ef- 
fects of Television Advertising Be Measured? Part I: 
Recall. Technical and Analytical Review, No. 4, 
Spring 1960, pp. 1-16. 

The answer to the question posed by this pam- 
phlet seems to be “periodically.” 

Written at a non-technical level, it first examines 
selected learning theory experiments by Luh and 
Kreuger, who found learning and retention to vary 
depending on the task to be learned, measurements 
made and time intervals used. Schwerin warns that 
the motivation variable—positive in Luh’s and 
Kreuger’s test environment, but of unknown in- 
fluence in the advertising environment—will also 
serve to restrict the generality of psychological 
learning theory data to advertising. 

The theme of the pamphlet may be summarized 
as follows: what is the effect of television commer- 
cial repetition upon learning? The criterion for 
learning is recall of a commercial at different points 
in time. 

Three measures of recall are used: total responses 
(brand name and 20 pre-coded ideas) per 100 per- 
sons, volunteered recall of slogan, and share of 
audience recalling brand name and at least one 
sales point. This interesting method highlights the 
largely subjective nature of recall measures in gen- 
eral. 

Schwerin maintains that changes in the level of 
recall after two or four weeks suggest positive or 
negative motivation leading to the learning or for- 
getting of a commercial. The reader will accept this 
conclusion more readily if he believes that the ini- 
tial recall measure was free of any group-inspired 
motivation associated with the theater technique, 
and that one sample of respondents can be com- 
pared legitimately with another. 

The pamphlet does not analyze results statisti- 
cally «ec determine whether some levels of obtained 
recall differed significantly from others. This may 
reflect the authors’ desire to simplify results or to 
recognize that the samples are not comparable. The 
latter condition may invalidate the comparisons 
made in this study, but those individuals responsi- 
ble for gauging the memorability of TV commer- 
cials should value such comparisons. They rarely 
appear in the published literature. 
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Readers who question whether commercial recall 
is an appropriate measure of television’s effect will 
be interested in another Schwerin pamphlet to be 
published soon. It promises to report television’s 
effect on changes in attitude and behavior. 


—THORNTON C. Lockwoop 


The Anatomy of 


New Product Success 


Louis A. Fourt and Joseph W. Woodlock. Early Predic- 
tion of Market Success for New Grocery Products. 
Journal of Marketing, Vol. 25, No. 2, April 1960, 
pp- 31-38. 

In this interesting paper Messrs. Fourt and Wood- 
lock describe their method of predicting the market 
success of new consumer products. Although the 
approach they describe can be applied equally well 
to products new or old, they point out in their first 
paragraph that four out of five new products 
launched between 1945 and 1955 are reported to 
have failed. This emphasis on new products is 
further justified by another opinion, quoted by the 
authors, that it usually takes 19 to 24 months to 
know whether a new product is successful or not. 

Now the study of new products is a cake that can 
be sliced a good many ways. You can study, for ex- 
ample, the way in which consumers switch from one 
brand to another. You might concentrate your at- 
tention on the size of the purchase of some group 
of consumers. You may prefer to study how long it 
takes a user to get around to buying again. You may 
be old-fashioned, or just artistic, and keep a sales 
chart over your desk. The authors prefer to study 
the expansion of new users and the time interval 
between repeat purchases. 

The interesting features of any method of pre- 
diction in marketing or elsewhere are of three kinds. 
First there are some assumptions about the way the 
system, in this case the market, operates. If you keep 
up with the Joneses you will call this the mathe- 
matical model. Then you need some minimum 
amount of information to make any prediction at 
all. Thirdly, you and everyone else wants to know 
how well the prediction worked out. 

In this article it is assumed that every new prod- 
uct is born with some upper limit to the number of 
its users. This upper limit does not stay the same 
but slowly and uniformly increases with time. It is 
also assumed that in any time interval, the number 
of extra new users gained will be proportional to 
the number of people represented by the upper 


limit of penetration who had not previcusly tried — 
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the product. These assumptions are sufficient to 
predict for any product the familiar growth curve 
looking like the top half of a martini glass on its 
side. 

The information we need for prediction is then: 
an upper limit to the eventual penetration of the 
brand; a constant to indicate how this ceiling will 
increase with time; and the proportion of available 
non-users who will be persuaded to use the product 
in any time period. With all these we could predict 
the proportion of people using the brand at any 
time in the future, given some broad assumptions 
about the rest of the world staying much as it is 
and your competition lying down under your efforts. 

Unfortunately the way in which this minimum 
information is put together is not quite clear. Ob- 
viovsly if the product has been around a little time 
and the rate at which it is gaining new customers is 
known, then the upper limit of its penetration is 
easily estimated. The authors’ statement, “Experi- 
ence with a large number of earlier new products 
is used to predetermine the general functional form 
or shape of the cumulative penetration as a func- 
tion of time,” seems to indicate that they, like the 
rest of us, draw some free-hand curves now and 
then. 

If we accept these predictions of the number of 
users we can pass to the prediction of sales volume. 
For this the authors have studied the number of users 
who repeat their purchases once, twice, three times 
and so on in some definite time period. Their ex- 
perience confirms what we might expect, that the 
average size of a repeat purchase is somewhat larger 
than the initial purchase. Looking ahead, they pre- 
dict from the method previously described the num- 
ber of new purchasers, and from their observations 
they predict how many of these have become repeat 
purchasers, buying the product various numbers of 
times. Together with the average purchase size this, 


of course, all adds and multiplies up to a prediction | 


of sales volume. 

Finally the hardest question: How good is the 
prediction? The illustration given in the article is 
a worked example showing a 23 per cent predicted 
loss compared to an actual loss of 27 per cent. This, 


the authors say, is not the pick of the crop. They } 


might well have said that this is as much a predic 


tion of the stability of our world as it is of the suc 


cess of a new product. 
This paper is a clear account in understandable 
terms of a method with strong intuitive appeal. 
—Gwyn COLLINS 
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Measuring the 


National Image 


United States Information Agency—Office of Research 
and Analysis. Post-Summit Trends in British and 
French Opinion of the United States and the Soviet 
Union, June 1960. In the New York Times, Octo- 
ber 27, 1960. 

The U. S. Government, like many large corpora- 
tions, carries out research to evaluate the effective- 
ness of its promotional program. The United States 
Information Agency, for example, regularly con- 
ducts surveys of foreign public opinion of the 
USA and its “competitor’—the Soviet Union. 
While these surveys are not normally published, 
two newspapers have recently printed their full 
texts. 

The present survey, conducted shortly after the 
summit meetings, was not a full scale operation as 
was a pre-summit survey, but included only a lim- 
ited group of selected questions as “riders” to on- 
going research. The British study was based on 
1,150 cases interviewed between May 21 and 24; 
the French study consisted of 1,000 cases inter- 
viewed between May 23 and 31. No further details 
on the sample plan are given, but interested read- 
ers are invited to write USIA for further details. 

USIA notes that in the wake of the summit fail- 
ure, both the USA and USSR suffered major losses 
in general standing. While the USSR is blamed 
most for the collapse of the summit conference, a 
majority blame both sides in part. Favorable opin- 
ion of the USA as a country and of President Eisen- 
hower has declined according to the report, but 
remains far ahead of Soviet Russia and Premier 
Khrushchev, both of whom also suffered losses in 
esteem. Awareness of the sequence of three USA 
space successes was limited in Great Britain, and in 
France public opinion put the USSR overwhelm- 
ingly ahead in space development. 

An interesting feature in reporting the results of 
these surveys is the use of a “net favorable” index: 
favorable answers minus unfavorable answers. Ac- 
cording to USIA such an index often provides a 
useful basis of comparison, since it helps take into 
account the extent to which favorable responses are 
off-set by unfavorable responses. The meaningful- 
ness of off-setting favorable by unfavorable re- 
sponses, however, would require that the degree of 
total favorableness equal the degree of total unfa- 
vorableness. Even when degrees of favorable and 
unfavorable are available, ie., “very good” and 
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“good,” or ‘very bad” and “bad,” all good replies 
are apparently combined and subtracted from all 
bad replies; neutral replies, or no replies, are ig- 
nored. On this basis a shift in one country’s stand- 
ing from bad to neutral, or no replies, would show 
a gain in standing while a shift in the other coun- 
try’s standing from “good” to “very good” would 
show no gain. Even if “very good” were weighted 
twice as much as “good,” we would have no guar- 
antee that the distance from “good” to “very good” 
would be the same for any individual as his dis- 
tance from “very bad” to “bad.” It would seem that 
any algebraic manipulation of such an index could 
mislead the very person for whom it was designed, 
the busy executive not skilled in research tech- 
niques. 

In most cases the questions asked of the respond- 
ent are reported along with the results. The pro- 
cedure used in asking these, however, is not al- 
ways given and it is impossible to tell whether 
precautions were taken against influencing the re- 
spondent by the order of listing the countries, the 
order of the alternatives, etc. 

Standardized questions were asked with responses 
limited to several stated alternatives. Although a 
“no opinion” category was provided to prevent 
forcing the respondent to make a selection, this 
category has apparently received little thought in 
the analysis. In determining the reaction to the U-2 
incident, the respondent was asked: “Have you 
heard or read about the recent incident in which 
an American plane, said to have been spying, was 
shot down by the Russians?” After being told that 
the plane was spying the respondent is then asked 
whether or not his opinion of the USA has been af- 
fected, whether the act was justified, etc. This one 
question, if asked early in the study, might have 
influenced the respondent’s replies to all subse- 
quent questions. In another case, the respondent 
was asked: “Is America doing all it should do to 
prevent a new world war?” The use of absolutes 
such as “all” generally encourages a negative re- 
sponse. 

Public opinion is terribly difficult to analyze. 
Many factors influence attitudes, tools of measure- 
ment are complicated and at best one is never sure 
just what is being measured. To interpret such re- 
search done in foreign languages compounds the 
difficulties many times. USIA has nonetheless shown 
where something was amiss and provided pointers 
for remedial action. 

—GEorGE M. SHIREY 
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PUBLICATIONS RECEIVED 


Mary E. McManon 
ARF Librarian 


Our collections have been enriched more rapidly 
than usual of late, partly due to the publication of 
this Journal, and partly because of the issuance of 
ARF’s Sources of Published 
Advertising Research. Sev- 
eral book publishers and 
university presses have al- 
ready supplied the Journal 
with review copies of recent 
books; many more have 
promised to do so as vol- 
umes of interest to advertis- 
ing and marketing people 
become available. 

The gathering of all materials listed in Sources 
—bibliographies, abstracting periodicals, directories, 
and lists of special libraries and professional bibli- 
ographers—began last December. Many, of course, 
were already on hand. Searches have been instituted 
for more elusive items and those now out of print. 
New publications of the types mentioned above will 
be acquired as they appear, and annotated in sub- 
sequent editions of Sources. 

Thus ARF’s library will probably be the most 


complete repository of secondary sources of adver- | 


tising research. Most of these items are available on 
loan to ARF members, who are encouraged to use 
our library facilities. 

Few primary sources such as books or articles are 
included in Sources of Published Advertising Re- 
search. Rather, it serves as a guide to the forms in 
which primary sources are collected and organized. 
Hopefully, Sources will remind researchers of exist- 
ing reference tools and indicate new uses for them. 
It should also assist librarians in the accumulation 
of additional reference works. 

Most of our new acquisitions are listed below. 
These are available from their respective publish- 
ers, or on loan from ARF. 


Abelson, Herbert I., Persuasion: How Opinions and Attitudes 
Are Changed. New York: Springer Publishing Company, 
Inc., 1959. 118pp. $3.75. 

*Audits and Surveys Company, Inc. and Erdos & Morgan 
Research Service, The Third National Study of Sports 
Illustrated Subscriber Households. New York: Time, Inc., 
1960. 124pp. Free. 


* Done in consultation with ARF. 
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Baylor, Aly, A Motivational Research on the Greater Lo; 
Angeles Television Audience. Los Angeles: Department of 
Economics and Marketing, Woodbury College, 1960. 1(pp. 
Free. 

Bristol, Lee H., Jr. (Editor), Developing the Corporate Image: 
A Management Guide to Public Relations. New York: 
Charles Scribner's Sons, 1960. 298pp. $5.95. 

Burke Marketing Research, Inc., A Chart Summary: The 
Effectiveness of Color vs. Black-and-White Television Ad. 
vertising. Cincinnati: Crosley Broadcasting Corporation, 
May 4, 1960. 1lpp. Free. 

Burke Marketing Research, Inc., The Effectiveness of Color 
vs. Black-and-White Television Advertising. Cincinnati: 
Crosley Broadcasting Corporation, May 4, 1960. 13pp. Free, 


Cheskin, Louis, Why People Buy: Motivation Research and 
Its Successful Application. New York: Liveright Publishing 
Corporation, 1959. 348pp. $5.00. 

Chicago Sun-Times, Chicago Daily News, 1960 Chicago Sun- 
Times, Chicago Daily News Consumer Analysis. Chicago: 
Field Enterprises, Inc.—Newspaper Division, 1960. 230pp. 
Free. 


Deming, W. Edwards, Sample Design in Business Research. 
New York: John Wiley & Sons, Inc., 1960. 517pp. $12.00. 
Des Moines Register and Tribune, Des Moines Register and 
Tribune Brand Inventory in the Homes of Iowa Sub- 
scribers. Des Moines: Des Moines Register and ‘Tribune, 

1960. Over 100pp. Free. 

Dichter, Ernest, The Strategy of Desire. Garden City, New 

¥ York: Doubleday & Company, Inc., 1960. 314pp. $3.95. 

The Dispatch Printing Company, The 1960 Columbus Dis- 
patch, Columbus Citizen-Journal Consumer Analysis. 
Columbus: The Dispatch Printing Company, 1960. 110pp. 
Free. 

Dix, Arthur H., How to Measure the Value of Advertising. 

t, New York: Conover-Mast Publications, Inc., 1960. 33pp. 
Free. 

Dominick, Bennett A., Jr., Research in Retail Merchandising 
of Farm Products—Appraisal of Methods and Annotated 
Bibliography. Washington, D. C.: Agricultural Marketing 
Service, U. S$. Department of Agriculture, July 1960. 46pp. 
Free. 

Duluth Herald, Duluth News-Tribune, The 1960 Consumer 
Analysis of the Duluth-Superior Market. Duluth: Duluth 
Herald, Duluth News-Tribune, 1960. 98pp. Free. 


yt _ *Erdos and Morgan, The Esquire Subscriber’s Leisure Activt- 


\ ties. New York: Esquire, August 1969. 48pp. Free. 


Fawcett Publications, Inc. Research Department, Men’s Ap- 
parel Survey. New York: True, The Man’s Magazine, 1960. 
47pp. Free. 

Fenton, John M., In Your Opinion ... The Managing 
Editor of the Gellup Poll Looks at Polls, Politics, and the 
People from 1945 to 1960. Boston: Little, Brown and 
Company, 1960. 220pp. $3.95. 


Good Housekeeping, Dessert Survey: A Good Housekeeping 
Consumer Panel Report. New York: The Hearst Corpora: 
tion, 1960. 86pp. Free. 

Gunther, Edgar and Frederick A. Goldstein, (Editors), Cur 
rent Sources of Marketing Information: A Bibliography of 
Primary Marketing Data. Chicago: American Marketing 
Association, August 1960. 119pp. $2.00 to AMA members: 
$4.00 to non-members. 
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Hanan, Mack, The Pacifiers: The Six Symbols We Live By. 
Boston: Little, Brown and Company, 1960. 306pp. $5.00. 
Hattwick, Melvin S., The New Psychology of Selling. New 
York: McGraw-Hill Book Company, Inc., 1960. 276pp. 
$5.95. 
Havas, Nick, Violet Davis Grubbs and Hugh M. Smith, 
Combining Kinds of Retailer Promotions: Effect on Sales 
of Selected Food Products. Washington, D. C.: Agricultural 
Marketing Service, U. S. Department of Agriculture, Au- 
gust 1960. 16pp. Free. 


Havas, Nick, Peter L. Henderson, Ches:er $. Parsons and 
Paul Schaffer, Displaying Fruit in Various Types of Pack- 
ages and in Bulk ... Costs and Effects on Quality and 
Sales. Washington, D. C.: Agricultural Marketing Service, 
U. S. Department of Agriculture, August 1960. 22pp. Free. 

Havas, Nick and Hugh M. Smith, Customers’ Shopping Pat- 
terns in Retail Food Stores: An Exploratory Study. Wash- 
ington, D. C.: Agricultural Marketing Service, U. S. Depart- 
ment of Agriculture, August 1960. l4pp. Free. 

Honoluiu Star-Bulletin, 1960 Consumer Analysis of the Oahu 
Market (including Honolulu). Honolulu, Hawaii: Hono- 
lulu Star-Bulletin, 1960. 123pp. Free. 

Howard, Ronald A., Dynamic Programming and Markov 
Processes. New York: John Wiley & Sons, Inc., 1960. 136pp. 
$5.75. 


Kirkpatrick, C. A., Advertising: Mass Communication in Mar- 
keting. Boston: Houghton Mifflin Company, 1959. 638pp. 
$7.50. 


Lockley, Lawrence C., Use of Motivation Research in Mar- 
keting. New York: National Industrial Conference Board, 
Inc., 1960. 27pp. $1.50 to NICB associates; $7.50 to non- 
associates. 

Lohse, Charles F., Creative Selling. New York: Charles Scrib- 
ner’s Sons, 1960. 212pp. $4.95. 


The Long Beach Independent, Press-Telegram, 1960 Con- 
sumer Analysis of the Long Beach, California Market. Long 
Beach: The Long Beach Independent, Press-Telegram, 
1960. 91 pp. Free. 


Marplan, A Study of Farm Publications in Eight Midwestern 
States. Chicago: Midwest Farm Paper Unit, 1960. 70pp. 
Free. 


Mason, Edward S., (Editor), The Corporation in Modern So- 
ciety. Cambridge: Harvard University Press, 1960. 335pp. 
$6.75. 


McCarthy, E. Jerome, Basic Marketing: A Managerial Ap- 
proach. Homewood, Illinois: Richard D. Irwin, Inc., 1960. 
770pp. $10.60. 

McClatchy Newspapers, 1960 Consumer Analysis: The Sacra- 
mento Bee, The Fresno Bee, The Modesto Bee. Sacramento, 
California: McClatchy Newspapers, 1960. 264pp. Free. 

McGraw-Hill Research, The Purchasing Week Survey of 

» Buying Influence Patterns. New York: McGraw-Hill Pub- 

\ lishing Co., Inc., 1960. 62pp. Free. 


Meloan, Taylor W. and John M. Rathmell, Selling: Its 
Broader Dimensions. New York: The Macmillan Company, 
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1960. 409pp. $7.50. 


Nationa! Industrial Conference Board, A Graphic Guide to 
Consumer Markets. New York: National Industrial Con- 
ference Board, 1960. 112pp. $3.50 to NICB associates; $35.00 
{0 non-associates. 

Nation's Business Research Department, A Study of the Cor- 
porate Personality: How Business Executives Appraise 
Leadin: Corporations Holding Military Prime Contracts. 
Washi: gton, D. C.: Nation’s Business, 1960. 107pp. Free. 
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Newark News, The Newark News Consumer Analysis. New- 
ark, New Jersey: Newark News, 1960. 62pp. Free. 


The Omaha World-Herald, 1960 Omaha World-Herald Con- 
sumer Analysis. Omaha, Nebraska: The Omaha World- 
Herald, 1960. 112pp. Free. 

Oregon Journal, 1960 Consumer Analysis of the Portland, 
Oregon Market. Portland: Oregon Journal, 1960. 98pp. 
i ree. 

Organisation for European Economic Co-operation, Market 
Research on a European Scale. Paris: The European Pro- 
ductivity Agency of the Organisation for European Eco- 
nomic Co-operation, June 1960. 136pp. $2.00. 


Politz, Alfred, Media Studies, The Rochester Study. Phila- 
delphia: ‘Lhe Saturday Evening Post, August 1960. 83pp. 
Free. 

The Providence Journal-Bulletin, 1960 Providence Consumer 
Analysis. Providence, Rhode Island: ‘The Providence Jour- 
nal-Bulletin, 1960. 115pp. Free. 


Rapoport, Anatol, Fights, Games, and Debates. Ann Arbor: 
The University of Michigan Press, 1960. 400pp. $6.95. 

Richmond ‘Times-Dispatch, ‘The Richmond News Leader, 
Households Reached by Radio and Television in Metro- 
politan Richmond. Richmond, Virginia: Richmond News- 
papers, Inc., June 1960. 7pp. Free. 


The St. Paul Dispatch-Pioneer Press, St. Paul Dispatch-Pio- 
neer Press 1960 Consumer Analysis of the St. Paul ABC 
City Zone. St. Paul, Minnesota: ‘The St. Paul Dispatch-Pio- 
neer Press, 1960. 214pp. Free. 

San Jose Mercury and News, 1960 Consumer Analysis of the 
San Jose ABC City Zone. San Jose, California: San Jose 
Mercury and News, 1960. 96pp. Free. 

Sandage, C. H. and Vernon Fryburger (Editors), The Role 
of Advertising: A Book of Readings. Homewood, Illinois: 
Richard D. Irwin, Inc., 1960. 499pp. $8.00. 

The Seattle Times, The Seattle Times 1960 Consumer Anal- 
ysis of Greater Seattle. Seattle: ‘The Seattle Times, 1960. 
119pp. Free. 

Simon, Herbert A., The New Science of Management Deci- 
sion. New York: Harper & Brothers, 1960. 50pp. $2.50. 

Smith, Hugh M., Customer Traffic Research. Washington, 
D. C.: Agricultural Marketing Service, U. S. Department 
of Agriculture, July 1960. I1pp. Free. 

Social Research, Inc., The Invisible Wall... The Social 
Factor in Mass Selling. New York: ‘True Story Women’s 
Group, 1960. 22pp. Free. ; 

Starch, Daniel and Staff, A Study Among Farmers Actively 
Engaged in Farming in New York State. Ithaca: American 
Agriculturist, 1960. 15pp. Free. 


Television Advertising Representatives, Inc., Viewing by 
Mothers of Young Children. New York: ‘Television Ad- 
vertising Representatives, Inc., 1960. 19pp. Free. 


Wallach, M. A., Research, Inc., Summer Servings in Urban 
American Homes. New York: American Can Company, 
undated. 3lpp. Free. 

Weiss, E. B., Planning Merchandising Strategy for 1961-1965. 
New York: Doyle Dane Bernbach, Inc., 1960. 73pp. Free. 
The Wichita Eagle, Wichita Eagle Consumer Analysis 1960. 

Wichita, Kansas: ‘The Wichita Eagle, 1960. 98pp. Free. 


Yamanaka, Jiro, A Method of Prediction of Readership Score 
(Newspaper Ads). Tokyo: Dentsu Advertising Ltd., 1960. 
44pp. Free. 
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Uniquack on Advertising Research 


Readers of the New York Times editorial page 
will recognize Uniquack as the computer that 
knows all the answers. With a low bow to its usual 
interrogator, James Reston, we publish herewith 
the transcript of a conversation between Uniquack 
and a representative of the advertising industry. 


Ap Man: We’ve all heard of your talents, Uniquack, and 
appreciate this opportunity to use them on problems 
of advertising research. But I hope you won't mind 
if I begin with what may be an embarrassing question. 
How is it your fellow computers were so erratic in 
predicting the vote election night? 

Uniquack: I feel no responsibility to defend my more 
fallible colleagues. They, poor fellows, are only as 
accurate as the programs and data they get fed. 

A: But why did the odds fluctuate so wildly? 

U: The trouble with you humans is that you keep con- 
fusing probabilities with amounts. Those were the 
odds that one man would win, even if by only one 
vote. Guesses about the margin of victory weren't 
tied to those odds. 

A: I’m confused already. But we're getting off the track. 
My real question is: can the sales or profit resulting 
from advertising really be measured? 

: Certainly. As a matter of fact, it already has. 

You don’t say. By whom? 

Don’t you think that back in the days when the 

catalog was their only promotional medium, the big 

mail-order houses knew pretty well how much they 
earned per dollar spent on advertising space? 

A: Maybe so, but you've taken an extremé case. There 
was only one advertising medium and only one place 
the consumer could buy. ‘How about measuring the 
profitability of advertising a well-distributed product 
in mass media? 

U: Same problem. Just more record keeping and busy 
work. And what are business machines for? 

A: That’s a laugh, coming from you. You can’t mean 
that in these days of the integrated marketing plan, 
we can measure the effects of any part of the plan 
just by feeding accurate records into a machine! 
What about pricing, distribution, coupons, free sam- 
ples, dealer promotions? What about the sales force? 

U: What about it? 

A: Well, it seems to me that if we’re going to find out 
what sales result from advertising, we would have 
to stop all the other marketing activities that lead 
to sales. No firm is going to stop using most of its 
weapons just to find out how well one of them 
works. Or are you suggesting we all go back to the 
mail-order business and use only catalogs? 

U: Not at all. You needn't control all the sales-causing 
factors as long as you measure how your total effort 
is divided among them—in each locality and in each 
time period. To make matters easier, you might 
record all the efforts in some common unit. 

A: Such as? 

U: As Alexander Woollcott replied to the woman’s club 
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president who said she didn’t know how to thank 
him, “ever since the Phoeniceans invented money, 
that has been no problem.” 
Very funny. So we record dollars spent on cach 
marketing action, in each place, during each period, 
and look for corresponding sales changes. Suppose 
we find that wherever and whenever advertising 
expenditures were increased, sales went up. How do 
we know that these sales weren’t caused by competi. 
tion relaxing, or the weather, or any other factor 
we can’t control? Or even that we increased the ad 
budget because the sales increased? 
You don’t. The whole point of this record kecping 
is to permit you to design and conduct useful ex. 
periments. 
Experiments? Have you seen our last earnings state- 
ment? 
The smaller your profits, the greater may be your 
need to get the benefits of experimentation. Call it 
“planned variation” if you like. All it means is that 
you vary advertising in a few test markets chosen at 
random. 
At random! That’s not the way we plan variations in 
advertising between markets. 
Then you'll never know the degree to which advertis- 
ing caused whatever sales changes you later observe. 
When you pick randomly when and where you'll 
change your advertising expenditure, then the effects 
of all those “other factors” can’t possibly bias your 
results except by chance. If you don’t mind my say- 
ing so, it’s also a way of eliminating “human” error. 
I'll let that pass. But I’m beginning to see what you 
mean. If I leave it to the sales manager to pick the 
areas that get doubled advertising budgets, he might 
pick those where sales have been bad for other 
reasons. Then those other reasons would be all 
mixed up with the doubled advertising as causes of 
whatever happened. 
Exactly. 
But suppose just by accident we pick test markets 
that are affected by some other factor I not only 
can’t contro] but also can’t even measure? 
You'll never know for sure. But you will know the 
odds of that happening by chance alone. If your 
experiment has lots of test markets, you can gel 
those odds up pretty high. 
Like those on election night? 
Yes, but remember that you can test the results ol 
your predictions more often than just every four yeas. 
That's some comfort, anyway. If it’s as easy as you 
make out, why hasn’t everyone tried experiment 
with advertising expenditures? 
Now you're getting out of my field. You fellows set 
the goals, we just do the adding and subtracting. 
Some days I wish I knew just what your goals are. 
Hmm. Well, thanks for a most instructive interview. 
Uniquack. Sorry to cut it short, but it’s lunch time 
and I’m hungry. But then you wouldn't know wha! 
that means. 

—CHARLES RAMON? 
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